mirror of https://github.com/hpcaitech/ColossalAI
e2c0e7f92a
* [hotfix] remove triton kernels from kernel init * revise bloom/llama kernel imports for infer |
||
---|---|---|
.. | ||
modeling | ||
policies | ||
__init__.py | ||
batch_infer_state.py | ||
engine.py | ||
kvcache_manager.py |