ColossalAI/colossalai/nn/parallel
eric8607242 9880fd2cd8
Fix state_dict key missing issue of the ZeroDDP (#2363)
* Fix state_dict output for ZeroDDP duplicated parameters

* Rewrite state_dict based on get_static_torch_model

* Modify get_static_torch_model to be compatible with the lower version (ZeroDDP)
2023-01-09 14:35:14 +08:00
..
layers
__init__.py [Gemini] make gemini usage simple (#1821) 2022-11-08 15:53:13 +08:00
data_parallel.py Fix state_dict key missing issue of the ZeroDDP (#2363) 2023-01-09 14:35:14 +08:00
gemini_parallel.py [Gemini] chunk init using runtime visited param order (#2115) 2022-12-12 18:06:16 +08:00
reducer.py
utils.py Fix state_dict key missing issue of the ZeroDDP (#2363) 2023-01-09 14:35:14 +08:00