ColossalAI/colossalai/zero/sharded_optim
Jiarui Fang 21dc54e019
[zero] memtracer to record cuda memory usage of model data and overall system (#395)
2022-03-14 22:05:30 +08:00
..
bookkeeping Feature/zero (#279) 2022-03-11 15:50:28 +08:00
__init__.py impl shard optim v2 and add unit test 2022-03-11 15:50:28 +08:00
_utils.py Feature/zero (#279) 2022-03-11 15:50:28 +08:00
sharded_optim.py [zero] cpu adam kernel (#288) 2022-03-11 15:50:28 +08:00
sharded_optim_v2.py [zero] memtracer to record cuda memory usage of model data and overall system (#395) 2022-03-14 22:05:30 +08:00