ColossalAI/colossalai/nn/parallel
HELSON 707b11d4a0
[gemini] update ddp strict mode (#2518)
* [zero] add strict ddp mode for chunk init

* [gemini] update gpt example
2023-01-28 14:35:25 +08:00
..
layers
__init__.py
data_parallel.py [gemini] update ddp strict mode (#2518) 2023-01-28 14:35:25 +08:00
gemini_parallel.py [gemini] update ddp strict mode (#2518) 2023-01-28 14:35:25 +08:00
reducer.py
utils.py [polish] polish code for get_static_torch_model (#2405) 2023-01-09 17:41:38 +08:00