youngkingdom/cutlass
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Files
8e85580859f0a92bf172c10dedeb4fdf4b59d703
cutlass/examples
History
dan_the_3rd 146d314057 Update fMHA kernels (#992) 
* Update fMHA kernels

Upstream recent changes to fMHA that we did in xFormers.
Previous version in CUTLASS: facebookresearch/xformers@b6be33a
Updating to: facebookresearch/xformers@55a4798

* minor changes

* make var work

---------

Co-authored-by: danthe3rd <danthe3rd>
Co-authored-by: Haicheng Wu <haichengw@nvidia.com>
2023-07-12 22:30:46 -04:00
..
00_basic_gemm
Fix typos 2 (#842)
2023-03-09 23:22:56 -05:00
01_cutlass_utilities
New updates for 2.11 (#775)
2023-01-20 16:32:57 -05:00
02_dump_reg_shmem
New updates for 2.11 (#775)
2023-01-20 16:32:57 -05:00
03_visualize_layout
New updates for 2.11 (#775)
2023-01-20 16:32:57 -05:00
04_tile_iterator
New updates for 2.11 (#775)
2023-01-20 16:32:57 -05:00
05_batched_gemm
New updates for 2.11 (#775)
2023-01-20 16:32:57 -05:00
06_splitK_gemm
New updates for 2.11 (#775)
2023-01-20 16:32:57 -05:00
07_volta_tensorop_gemm
Fix typos 2 (#842)
2023-03-09 23:22:56 -05:00
08_turing_tensorop_gemm
Updates for 3.1 (#932)
2023-04-29 09:34:27 -04:00
09_turing_tensorop_conv2dfprop
CUTLASS 3.1 (#915)
2023-04-14 23:19:34 -04:00
10_planar_complex
CUTLASS 3.0.0 (#786)
2023-01-23 20:55:28 -05:00
11_planar_complex_array
CUTLASS 3.0.0 (#786)
2023-01-23 20:55:28 -05:00
12_gemm_bias_relu
Updates for 3.1 (#932)
2023-04-29 09:34:27 -04:00
13_two_tensor_op_fusion
Add grouped b2b GEMM (#970)
2023-06-05 17:16:57 -04:00
14_ampere_tf32_tensorop_gemm
New updates for 2.11 (#775)
2023-01-20 16:32:57 -05:00
15_ampere_sparse_tensorop_gemm
New updates for 2.11 (#775)
2023-01-20 16:32:57 -05:00
16_ampere_tensorop_conv2dfprop
CUTLASS 3.1 (#915)
2023-04-14 23:19:34 -04:00
17_fprop_per_channel_bias
New updates for 2.11 (#775)
2023-01-20 16:32:57 -05:00
18_ampere_fp64_tensorop_affine2_gemm
New updates for 2.11 (#775)
2023-01-20 16:32:57 -05:00
19_tensorop_canonical
New updates for 2.11 (#775)
2023-01-20 16:32:57 -05:00
20_simt_canonical
New updates for 2.11 (#775)
2023-01-20 16:32:57 -05:00
21_quaternion_gemm
New updates for 2.11 (#775)
2023-01-20 16:32:57 -05:00
22_quaternion_conv
CUTLASS 3.1 (#915)
2023-04-14 23:19:34 -04:00
23_ampere_gemm_operand_reduction_fusion
Fix typos 2 (#842)
2023-03-09 23:22:56 -05:00
24_gemm_grouped
CUTLASS 3.1 (#915)
2023-04-14 23:19:34 -04:00
25_ampere_fprop_mainloop_fusion
New updates for 2.11 (#775)
2023-01-20 16:32:57 -05:00
26_ampere_wgrad_mainloop_fusion
New updates for 2.11 (#775)
2023-01-20 16:32:57 -05:00
27_ampere_3xtf32_fast_accurate_tensorop_gemm
New updates for 2.11 (#775)
2023-01-20 16:32:57 -05:00
28_ampere_3xtf32_fast_accurate_tensorop_fprop
New updates for 2.11 (#775)
2023-01-20 16:32:57 -05:00
29_ampere_3xtf32_fast_accurate_tensorop_complex_gemm
CUTLASS 3.1 (#915)
2023-04-14 23:19:34 -04:00
30_wgrad_split_k
New updates for 2.11 (#775)
2023-01-20 16:32:57 -05:00
31_basic_syrk
Updates for 3.1 (#932)
2023-04-29 09:34:27 -04:00
32_basic_trmm
Updates for 3.1 (#932)
2023-04-29 09:34:27 -04:00
33_ampere_3xtf32_tensorop_symm
New updates for 2.11 (#775)
2023-01-20 16:32:57 -05:00
34_transposed_conv2d
New updates for 2.11 (#775)
2023-01-20 16:32:57 -05:00
35_gemm_softmax
Increase max dynamic SMEM size in GemmSoftmax (#903)
2023-04-03 10:01:12 -04:00
36_gather_scatter_fusion
New updates for 2.11 (#775)
2023-01-20 16:32:57 -05:00
37_gemm_layernorm_gemm_fusion
CUTLASS 3.0.0 (#786)
2023-01-23 20:55:28 -05:00
38_syr2k_grouped
New updates for 2.11 (#775)
2023-01-20 16:32:57 -05:00
39_gemm_permute
CUTLASS 3.1 (#915)
2023-04-14 23:19:34 -04:00
40_cutlass_py
CUTLASS 3.1 (#915)
2023-04-14 23:19:34 -04:00
41_fused_multi_head_attention
Update fMHA kernels (#992)
2023-07-12 22:30:46 -04:00
42_ampere_tensorop_group_conv
New updates for 2.11 (#775)
2023-01-20 16:32:57 -05:00
43_ell_block_sparse_gemm
New updates for 2.11 (#775)
2023-01-20 16:32:57 -05:00
44_multi_gemm_ir_and_codegen
Fix typos 2 (#842)
2023-03-09 23:22:56 -05:00
45_dual_gemm
More updates for 3.1 (#958)
2023-05-24 10:17:16 -04:00
46_depthwise_simt_conv2dfprop
CUTLASS 3.1 (#915)
2023-04-14 23:19:34 -04:00
47_ampere_gemm_universal_streamk
More updates for 3.1 (#958)
2023-05-24 10:17:16 -04:00
48_hopper_warp_specialized_gemm
CUTLASS 3.1 (#915)
2023-04-14 23:19:34 -04:00
49_hopper_gemm_with_collective_builder
Updates for 3.1 (#932)
2023-04-29 09:34:27 -04:00
50_hopper_gemm_with_epilogue_swizzle
CUTLASS 3.1 (#915)
2023-04-14 23:19:34 -04:00
51_hopper_gett
CUTLASS 3.1 (#915)
2023-04-14 23:19:34 -04:00
60_cutlass_import
New updates for 2.11 (#775)
2023-01-20 16:32:57 -05:00
common
CUTLASS 3.1 (#915)
2023-04-14 23:19:34 -04:00
cute
CUTLASS 3.1 (#915)
2023-04-14 23:19:34 -04:00
python
CUTLASS 3.1 (#915)
2023-04-14 23:19:34 -04:00
CMakeLists.txt
CUTLASS 3.1 (#915)
2023-04-14 23:19:34 -04:00