Jianghai c064032865 [Online Server] Chat Api for streaming and not streaming response (#5470) ... * fix bugs * fix bugs * fix api server * fix api server * add chat api and test * del request.n		2024-05-08 15:20:53 +00:00
..
kit	[shardformer] fix chatglm implementation (#5644)	2024-04-25 14:41:17 +08:00
test_analyzer	[misc] update pre-commit and run all files (#4752)	2023-09-19 14:20:26 +08:00
test_auto_parallel	[misc] refactor launch API and tensor constructor (#5666)	2024-04-29 10:40:11 +08:00
test_autochunk	[misc] update pre-commit and run all files (#4752)	2023-09-19 14:20:26 +08:00
test_booster	[misc] refactor launch API and tensor constructor (#5666)	2024-04-29 10:40:11 +08:00
test_checkpoint_io	[misc] refactor launch API and tensor constructor (#5666)	2024-04-29 10:40:11 +08:00
test_cluster	[misc] refactor launch API and tensor constructor (#5666)	2024-04-29 10:40:11 +08:00
test_config	[misc] update pre-commit and run all files (#4752)	2023-09-19 14:20:26 +08:00
test_device	[misc] refactor launch API and tensor constructor (#5666)	2024-04-29 10:40:11 +08:00
test_fx	[misc] refactor launch API and tensor constructor (#5666)	2024-04-29 10:40:11 +08:00
test_infer	[Online Server] Chat Api for streaming and not streaming response (#5470)	2024-05-08 15:20:53 +00:00
test_lazy	[lazyinit] skip whisper test (#5653)	2024-04-26 14:03:12 +08:00
test_legacy	[misc] refactor launch API and tensor constructor (#5666)	2024-04-29 10:40:11 +08:00
test_lora	[misc] refactor launch API and tensor constructor (#5666)	2024-04-29 10:40:11 +08:00
test_moe	[misc] refactor launch API and tensor constructor (#5666)	2024-04-29 10:40:11 +08:00
test_optimizer	[misc] refactor launch API and tensor constructor (#5666)	2024-04-29 10:40:11 +08:00
test_pipeline	[misc] refactor launch API and tensor constructor (#5666)	2024-04-29 10:40:11 +08:00
test_shardformer	[misc] refactor launch API and tensor constructor (#5666)	2024-04-29 10:40:11 +08:00
test_smoothquant	[inference] Add smmoothquant for llama (#4904)	2023-10-16 11:28:44 +08:00
test_tensor	[misc] refactor launch API and tensor constructor (#5666)	2024-04-29 10:40:11 +08:00
test_zero	[misc] refactor launch API and tensor constructor (#5666)	2024-04-29 10:40:11 +08:00
__init__.py	[zero] Update sharded model v2 using sharded param v2 (#323)	2022-03-11 15:50:28 +08:00