Yuanheng Zhao e2c0e7f92a [hotfix] Fix import error: colossal.kernel without triton installed (#4722) ... * [hotfix] remove triton kernels from kernel init * revise bloom/llama kernel imports for infer		2023-09-14 18:03:55 +08:00
..
modeling	[hotfix] Fix import error: colossal.kernel without triton installed (#4722)	2023-09-14 18:03:55 +08:00
policies	[hotfix] Fix import error: colossal.kernel without triton installed (#4722)	2023-09-14 18:03:55 +08:00
__init__.py	[Feature] The first PR to Add TP inference engine, kv-cache manager and related kernels for our inference system (#4577)	2023-09-12 01:22:56 +08:00
batch_infer_state.py	[Feature] The first PR to Add TP inference engine, kv-cache manager and related kernels for our inference system (#4577)	2023-09-12 01:22:56 +08:00
engine.py	[Feature] The first PR to Add TP inference engine, kv-cache manager and related kernels for our inference system (#4577)	2023-09-12 01:22:56 +08:00
kvcache_manager.py	[Feature] The first PR to Add TP inference engine, kv-cache manager and related kernels for our inference system (#4577)	2023-09-12 01:22:56 +08:00