ColossalAI/colossalai/zero
Hongxin Liu 5dfbcd7746
[zero] use bucket during allgather (#5860)
* [zero] use bucket during allgather

* [zero] rename api
2024-06-27 16:34:44 +08:00
..
gemini [gemini] fixes for benchmarking (#5847) 2024-06-26 15:52:09 +08:00
low_level [zero] use bucket during allgather (#5860) 2024-06-27 16:34:44 +08:00
__init__.py [shardformer]: support gpt-j, falcon, Mistral and add interleaved pipeline for bert (#5088) 2023-11-28 16:54:42 +08:00
wrapper.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00