ColossalAI/tests/test_infer/test_ops/cuda
Steve Luo f7aecc0c6b
feat rmsnorm cuda kernel and add unittest, benchmark script (#5417)
2024-03-08 16:21:12 +08:00
..
__init__.py [Inference]Add CUDA KVCache Kernel (#5406) 2024-02-28 14:36:50 +08:00
test_kv_cache_memcpy.py [Inference]Add CUDA KVCache Kernel (#5406) 2024-02-28 14:36:50 +08:00
test_rms_layernorm.py feat rmsnorm cuda kernel and add unittest, benchmark script (#5417) 2024-03-08 16:21:12 +08:00
test_silu_and_mul.py add silu_and_mul for infer 2024-03-07 16:57:49 +08:00