ColossalAI/colossalai/zero
Jiarui Fang 05e33b2578
[zero] fix grad offload (#528)
* [zero] fix grad offload

* polish code
2022-03-25 18:23:25 +08:00
..
init_ctx [zero] refactor model data tracing (#522) 2022-03-25 18:03:32 +08:00
shard_utils [zero] refactor model data tracing (#522) 2022-03-25 18:03:32 +08:00
sharded_model [zero] fix grad offload (#528) 2022-03-25 18:23:25 +08:00
sharded_optim [zero] fix grad offload (#528) 2022-03-25 18:23:25 +08:00
sharded_param [zero] refactor model data tracing (#522) 2022-03-25 18:03:32 +08:00
__init__.py [refactor] remove old zero code (#517) 2022-03-25 14:54:39 +08:00