46 template <
typename Traits_,
typename LoadIterator_,
typename StoreIterator_,
48 FragmentCopy<typename StoreIterator_::Fragment, typename LoadIterator_::Fragment>,
49 typename Index_ =
int>
75 typedef typename LoadIterator::Fragment
Fragment;
187 load_iterator.initialize_predicates(predicates_it, bounds, block_offset);
StoreIterator store_iterator
Stores fragment to shared memory.
Definition: fragment_stream.h:132
Base::Fragment Fragment
Fragment definition.
Definition: tile_iterator.h:606
Defines a structure containing strides, bounds, and a pointer to tensor data.
StoreParams store_params
Parameters to the store iterator.
Definition: fragment_stream.h:106
LoadIterator::PredicateVector predicates
Predicate vector.
Definition: fragment_stream.h:129
Defines the Tile Traits concept and iterators for loading and storing to tiles efficiently.
Defines structural properties of complete GEMM computation.
CUTLASS_HOST_DEVICE Coord< 1 > make_Coord(int _0)
Helper to make a 2-element coordinate.
Definition: coord.h:241
StoreIterator::Storage Storage
Destination storage.
Definition: fragment_stream.h:81
CUTLASS_DEVICE FragmentStream(Params const ¶ms, Coord< 3 > const &bounds, Coord< 3 > const &block_offset=make_Coord(0, 0, 0))
Constructor.
Definition: fragment_stream.h:156
Fragment fetch
Fragment fetched by load iterator.
Definition: fragment_stream.h:135
CUTLASS_DEVICE void commit()
Commits the fragment.
Definition: fragment_stream.h:176
StoreIterator_ StoreIterator
Defines the store iterator.
Definition: fragment_stream.h:62
Adapter to enable random access to predicates via logical coordinate within a tile.
Definition: predicate_vector.h:435
Index_ Index
Index type.
Definition: fragment_stream.h:68
Fragment< Scalar, ShapeCount< Tile >::kCount, kFragmentSize > Storage
The storage.
Definition: tile_iterator.h:181
Base::Iterations Iterations
Iterations.
Definition: tile_iterator.h:346
static CUTLASS_DEVICE void shared_store_fence()
The memory fence for shared stores.
Definition: fragment_stream.h:145
Free functions for loading and storing to implementations of tile iteartor concepts.
CUTLASS_HOST_DEVICE void iterator_load_post_increment(InputIterator &iterator, Fragment &fragment, typename InputIterator::Index offset, ConstPredicateAdapter predicate_adapter)
Loads a fragment from an input iterator, masked by a predicate iterator.
Definition: iterator_access.h:113
StoreIterator::Storage SharedStoreStorage
The storage in shared memory.
Definition: fragment_stream.h:84
CUTLASS_DEVICE void initialize_predicates(Coord< 3 > const &bounds, Coord< 3 > const &block_offset)
Recomputes predicates.
Definition: fragment_stream.h:184
Defines constant expressions for mapping GEMM problem size and strides onto pitch-linear memory...
Manages a pair of iterators to stream data from global memory to shared.
Definition: fragment_stream.h:50
CUTLASS_DEVICE FragmentStream()
Definition: fragment_stream.h:152
#define CUTLASS_HOST_DEVICE
Definition: cutlass.h:37
Statically-sized array specifying Coords within a tensor.
Definition: coord.h:48
CUTLASS_HOST_DEVICE void iterator_store(OutputIterator &iterator, Fragment &fragment)
Stores a fragment to an output iterator.
Definition: iterator_access.h:174
LoadIterator::Params LoadParams
Load parameters.
Definition: fragment_stream.h:93
Convert_ Convert
Converts between tiles.
Definition: fragment_stream.h:65
StoreIterator::Fragment StoreFragment
Stored fragment type.
Definition: fragment_stream.h:78
Traits_ Traits
Defines traits of WMMA GEMM tile stream.
Definition: fragment_stream.h:56
CUTLASS_DEVICE void load()
Loads the fragment.
Definition: fragment_stream.h:167
StoreIterator::Params StoreParams
Store parameters.
Definition: fragment_stream.h:96
Adapter to enable random access to predicates via logical coordinate within a tile.
Definition: predicate_vector.h:466
LoadIterator::Fragment Fragment
Loaded fragment type.
Definition: fragment_stream.h:75
LoadIterator_ LoadIterator
Defines the load iterator.
Definition: fragment_stream.h:59
CUTLASS_HOST_DEVICE int initialize(LoadParams const &_load_params, StoreParams const &_store_params)
Initializes parameters.
Definition: fragment_stream.h:113
Defines properties of matrices used to denote layout and operands to GEMM kernels.
LoadParams load_params
Parameters to load iterator.
Definition: fragment_stream.h:103
Convert convert
Converts between load fragments and store fragments.
Definition: fragment_stream.h:138
Defines Fragment, a statically-sized array for storing parts of matrices within a thread's registers...
LoadIterator load_iterator
Loads fragment from global memory.
Definition: fragment_stream.h:126
Defines conversion operations among Fragments of different base type.
Parameters passed to initialize the ierator.
Definition: fragment_stream.h:91