ColossalAI/colossalai/zero/sharded_optim
ver217 642846d6f9
update sharded optim and fix zero init ctx (#457)
2022-03-18 15:44:47 +08:00
..
bookkeeping Feature/zero (#279) 2022-03-11 15:50:28 +08:00
__init__.py impl shard optim v2 and add unit test 2022-03-11 15:50:28 +08:00
_utils.py Feature/zero (#279) 2022-03-11 15:50:28 +08:00
sharded_optim.py [fp16] refactored fp16 optimizer (#392) 2022-03-15 10:05:38 +08:00
sharded_optim_v2.py update sharded optim and fix zero init ctx (#457) 2022-03-18 15:44:47 +08:00