Hongxin Liu c068ef0fa0 [zero] support all-gather overlap (#5898) ... * [zero] support all-gather overlap * [zero] add overlap all-gather flag * [misc] fix typo * [zero] update api		2024-07-11 18:59:59 +08:00
..
gemini	[gemini] fixes for benchmarking (#5847)	2024-06-26 15:52:09 +08:00
low_level	[zero] support all-gather overlap (#5898)	2024-07-11 18:59:59 +08:00
__init__.py	[shardformer]: support gpt-j, falcon, Mistral and add interleaved pipeline for bert (#5088)	2023-11-28 16:54:42 +08:00
wrapper.py	[misc] update pre-commit and run all files (#4752)	2023-09-19 14:20:26 +08:00