ColossalAI/colossalai/zero
Hongxin Liu c068ef0fa0
[zero] support all-gather overlap (#5898)
* [zero] support all-gather overlap

* [zero] add overlap all-gather flag

* [misc] fix typo

* [zero] update api
2024-07-11 18:59:59 +08:00
..
gemini
low_level [zero] support all-gather overlap (#5898) 2024-07-11 18:59:59 +08:00
__init__.py
wrapper.py