You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Cuiqing Li 4b977541a8 [Kernels] added triton-implemented of self attention for colossal-ai (#4241) ... * added softmax kernel * added qkv_kernel * added ops * adding tests * upload tets * fix tests * debugging * debugging tests * debugging * added * fixed errors * added softmax kernel * clean codes * added tests * update tests * update tests * added attention * add * fixed pytest checking * add cuda check * fix cuda version * fix typo		1 year ago
..
ops.py	[Kernels] added triton-implemented of self attention for colossal-ai (#4241)	1 year ago
qkv_matmul_kernel.py	[Kernels] added triton-implemented of self attention for colossal-ai (#4241)	1 year ago
softmax_kernel.py	[Kernels] added triton-implemented of self attention for colossal-ai (#4241)	1 year ago