Jianghai 69cd7e069d [Inference] ADD async and sync Api server using FastAPI (#5396) ... * add api server * fix * add * add completion service and fix bug * add generation config * revise shardformer * fix bugs * add docstrings and fix some bugs * fix bugs and add choices for prompt template		2024-05-08 15:18:28 +00:00
..
__init__.py	[shardformer, pipeline] add `gradient_checkpointing_ratio` and heterogenous shard policy for llama (#5508)	2024-04-01 11:34:58 +08:00
grad_ckpt_config.py	[shardformer] refactor pipeline grad ckpt config (#5646)	2024-04-25 15:19:30 +08:00
shard_config.py	[sync] resolve conflicts of merging main	2024-05-05 05:14:00 +00:00
sharder.py	[nfc] fix typo colossalai/shardformer/ (#5133)	2024-01-04 16:21:55 +08:00
shardformer.py	[Inference] ADD async and sync Api server using FastAPI (#5396)	2024-05-08 15:18:28 +00:00
utils.py	[pipeline] update shardformer policy	2023-08-15 23:25:14 +08:00