ColossalAI/colossalai/zero
Jiarui Fang 8711c706f4
[hotfix] fix grad offload when enabling reuse_fp16_shard
2022-04-18 14:58:21 +08:00
..
init_ctx [zero] refactor ShardedParamV2 for convenience (#742) 2022-04-13 14:54:26 +08:00
shard_utils [zero] refactor shard and gather operation (#773) 2022-04-15 14:41:31 +08:00
sharded_model [hotfix] fix memory leak in zero (#781) 2022-04-18 13:57:03 +08:00
sharded_optim [hotfix] fix grad offload when enabling reuse_fp16_shard 2022-04-18 14:58:21 +08:00
sharded_param [hotfix] fix memory leak in zero (#781) 2022-04-18 13:57:03 +08:00
utils [gemini] init genimi individual directory (#754) 2022-04-14 16:40:26 +08:00
__init__.py [refactor] remove old zero code (#517) 2022-03-25 14:54:39 +08:00