ColossalAI/colossalai/zero/sharded_optim
ver217 62b0a8d644
[zero] sharded optim support hybrid cpu adam (#486)
* sharded optim support hybrid cpu adam

* update unit test

* polish docstring
2022-03-22 14:56:59 +08:00
..
bookkeeping Feature/zero (#279) 2022-03-11 15:50:28 +08:00
__init__.py impl shard optim v2 and add unit test 2022-03-11 15:50:28 +08:00
_utils.py Feature/zero (#279) 2022-03-11 15:50:28 +08:00
sharded_optim.py [fp16] refactored fp16 optimizer (#392) 2022-03-15 10:05:38 +08:00
sharded_optim_v2.py [zero] sharded optim support hybrid cpu adam (#486) 2022-03-22 14:56:59 +08:00