ColossalAI/colossalai/zero/sharded_optim
Jiarui Fang bca0c49a9d
[zero] use colo model data api in optimv2 (#511)
2022-03-24 17:19:34 +08:00
..
bookkeeping Feature/zero (#279) 2022-03-11 15:50:28 +08:00
__init__.py impl shard optim v2 and add unit test 2022-03-11 15:50:28 +08:00
_utils.py Feature/zero (#279) 2022-03-11 15:50:28 +08:00
sharded_optim.py [fp16] refactored fp16 optimizer (#392) 2022-03-15 10:05:38 +08:00
sharded_optim_v2.py [zero] use colo model data api in optimv2 (#511) 2022-03-24 17:19:34 +08:00