Hongxin Liu 50793b35f4 [gemini] accelerate inference (#3641) ... * [gemini] support don't scatter after inference * [chat] update colossalai strategy * [chat] fix opt benchmark * [chat] update opt benchmark * [gemini] optimize inference * [test] add gemini inference test * [chat] fix unit test ci * [chat] fix ci * [chat] fix ci * [chat] skip checkpoint test		2023-04-26 16:32:40 +08:00
..
chunk	Add docstr for zero3 chunk search utils (#3572)	2023-04-17 12:44:17 +08:00
memory_tracer	[zero] reorganize zero/gemini folder structure (#3424)	2023-04-04 13:48:16 +08:00
__init__.py	[zero] reorganize zero/gemini folder structure (#3424)	2023-04-04 13:48:16 +08:00
colo_init_context.py	[doc] Fix typo under colossalai and doc(#3618)	2023-04-26 11:38:43 +08:00
gemini_ddp.py	[gemini] accelerate inference (#3641)	2023-04-26 16:32:40 +08:00
gemini_hook.py	[zero] reorganize zero/gemini folder structure (#3424)	2023-04-04 13:48:16 +08:00
gemini_mgr.py	[zero] reorganize zero/gemini folder structure (#3424)	2023-04-04 13:48:16 +08:00
gemini_optimizer.py	[misc] add verbose arg for zero and op builder (#3552)	2023-04-17 11:25:35 +08:00
placement_policy.py	[zero] reorganize zero/gemini folder structure (#3424)	2023-04-04 13:48:16 +08:00
utils.py	[zero] reorganize zero/gemini folder structure (#3424)	2023-04-04 13:48:16 +08:00