ColossalAI/colossalai/zero
ver217 8dced41ad0
[zero] zero optim state_dict takes only_rank_0 (#1384)
* zero optim state_dict takes only_rank_0

* fix unit test
2022-07-29 13:22:50 +08:00
..
init_ctx [hotfix] fix zero init ctx numel (#1128) 2022-06-16 17:17:27 +08:00
shard_utils [gemini] add GeminiMemoryManger (#832) 2022-04-24 13:08:48 +08:00
sharded_model [hotfix] shared model returns cpu state_dict (#1328) 2022-07-15 22:11:37 +08:00
sharded_optim [checkpoint] sharded optim save/load grad scaler (#1350) 2022-07-21 15:21:21 +08:00
sharded_param [gemini] add GeminiMemoryManger (#832) 2022-04-24 13:08:48 +08:00
utils [hotfix] remove potiential circle import (#1307) 2022-07-14 13:44:26 +08:00
__init__.py [zero] add zero optimizer for ColoTensor (#1046) 2022-06-02 12:13:15 +08:00
zero_optimizer.py [zero] zero optim state_dict takes only_rank_0 (#1384) 2022-07-29 13:22:50 +08:00