ColossalAI/colossalai/nn/parallel
HELSON c6a1a62636
[hotfix] fix zero's incompatibility with checkpoint in torch-1.12 (#1786)
* [hotfix] fix zero's incompatibility with checkpoint in torch-1.12

* [zero] add cpu shard init

* [zero] add tiny example test

* [colo_tensor] fix bugs for torch-1.11
2022-11-02 16:11:34 +08:00
..
layers [embedding] rename FreqAwareEmbedding -> CachedEmbedding (#1699) 2022-10-13 22:22:27 +08:00
__init__.py
data_parallel.py [hotfix] fix zero's incompatibility with checkpoint in torch-1.12 (#1786) 2022-11-02 16:11:34 +08:00
reducer.py
utils.py [feature] A new ZeRO implementation (#1644) 2022-10-09 09:18:51 +08:00