ColossalAI/colossalai/zero
ver217 a45ddf2d5f
[hotfix] fix sharded optim step and clip_grad_norm (#1226)
2022-07-08 13:34:48 +08:00
..
init_ctx [hotfix] fix zero init ctx numel (#1128) 2022-06-16 17:17:27 +08:00
shard_utils [gemini] add GeminiMemoryManger (#832) 2022-04-24 13:08:48 +08:00
sharded_model warmup ratio configration (#1192) 2022-06-30 15:23:50 +08:00
sharded_optim [hotfix] fix sharded optim step and clip_grad_norm (#1226) 2022-07-08 13:34:48 +08:00
sharded_param [gemini] add GeminiMemoryManger (#832) 2022-04-24 13:08:48 +08:00
utils [refactor] move chunk and chunkmgr to directory gemini (#1182) 2022-06-29 13:31:02 +08:00
__init__.py [zero] add zero optimizer for ColoTensor (#1046) 2022-06-02 12:13:15 +08:00
zero_optimizer.py [zero] zero optim supports loading local state dict (#1171) 2022-06-24 17:25:57 +08:00