ColossalAI/colossalai/zero
Jiarui Fang 237d08e7ee
[zero] hybrid cpu adam (#445)
2022-03-17 15:05:41 +08:00
..
init_ctx use double buffer to handle grad 2022-03-16 14:24:09 +08:00
shard_utils polish code 2022-03-14 15:48:55 +08:00
sharded_model [hotfix] fix initialize bug with zero (#442) 2022-03-17 13:16:22 +08:00
sharded_optim [refactory] refactory the initialize method for new zero design (#431) 2022-03-16 19:29:37 +08:00
sharded_param use double buffer to handle grad 2022-03-16 14:24:09 +08:00
__init__.py [zero] hybrid cpu adam (#445) 2022-03-17 15:05:41 +08:00