ColossalAI/colossalai/zero
ver217 561e90493f
[zero] zero optim supports loading local state dict (#1171)
* zero optim supports loading local state dict

* polish code

* add unit test
2022-06-24 17:25:57 +08:00
..
init_ctx [hotfix] fix zero init ctx numel (#1128) 2022-06-16 17:17:27 +08:00
shard_utils [gemini] add GeminiMemoryManger (#832) 2022-04-24 13:08:48 +08:00
sharded_model [hotfix] prevent nested ZeRO (#1140) 2022-06-21 11:33:53 +08:00
sharded_optim [hotfix] prevent nested ZeRO (#1140) 2022-06-21 11:33:53 +08:00
sharded_param [gemini] add GeminiMemoryManger (#832) 2022-04-24 13:08:48 +08:00
utils [zero] avoid zero hook spam by changing log to debug level (#1137) 2022-06-21 10:44:01 +08:00
__init__.py [zero] add zero optimizer for ColoTensor (#1046) 2022-06-02 12:13:15 +08:00
zero_optimizer.py [zero] zero optim supports loading local state dict (#1171) 2022-06-24 17:25:57 +08:00