ColossalAI/colossalai/zero
ver217 62b0a8d644
[zero] sharded optim support hybrid cpu adam (#486)
* sharded optim support hybrid cpu adam

* update unit test

* polish docstring
2022-03-22 14:56:59 +08:00
..
init_ctx [zero] polish sharded param name (#484) 2022-03-22 14:36:16 +08:00
shard_utils [doc] Update docstring for ZeRO (#459) 2022-03-18 16:48:20 +08:00
sharded_model [zero] sharded optim support hybrid cpu adam (#486) 2022-03-22 14:56:59 +08:00
sharded_optim [zero] sharded optim support hybrid cpu adam (#486) 2022-03-22 14:56:59 +08:00
sharded_param [zero] sharded optim support hybrid cpu adam (#486) 2022-03-22 14:56:59 +08:00
__init__.py [zero] Update initialize for ZeRO (#458) 2022-03-18 16:18:31 +08:00