ColossalAI/colossalai/zero
ver217 c9e8ce67b8
fix move fp32 shards (#1604)
2022-09-16 17:33:16 +08:00
..
init_ctx [hotfix] fix zero init ctx numel (#1128) 2022-06-16 17:17:27 +08:00
shard_utils [gemini] add GeminiMemoryManger (#832) 2022-04-24 13:08:48 +08:00
sharded_model [NFC] polish colossalai/zero/sharded_model/reduce_scatter.py code style (#1554) 2022-09-08 22:11:04 +08:00
sharded_optim fix move fp32 shards (#1604) 2022-09-16 17:33:16 +08:00
sharded_param [gemini] add GeminiMemoryManger (#832) 2022-04-24 13:08:48 +08:00
utils [hotfix] remove potiential circle import (#1307) 2022-07-14 13:44:26 +08:00
__init__.py [zero] add zero optimizer for ColoTensor (#1046) 2022-06-02 12:13:15 +08:00
zero_optimizer.py [utils] Impl clip_grad_norm for ColoTensor and ZeroOptimizer (#1442) 2022-08-11 22:58:58 +08:00