ColossalAI/colossalai/engine/ophooks
Jiarui Fang 21dc54e019
[zero] memtracer to record cuda memory usage of model data and overall system (#395)
2022-03-14 22:05:30 +08:00
..
__init__.py [zero] Update sharded model v2 using sharded param v2 (#323) 2022-03-11 15:50:28 +08:00
_base_ophook.py add pytorch hooks (#179) 2022-01-25 22:20:54 +08:00
_memtracer_ophook.py Flake8 code restyle 2022-03-11 15:50:28 +08:00
_shard_grad_ophook.py [zero] add sharded grad and refactor grad hooks for ShardedModel (#287) 2022-03-11 15:50:28 +08:00
_shard_param_ophook.py fix sharded param hook and unit test 2022-03-11 15:50:28 +08:00
zero_hook.py [zero] memtracer to record cuda memory usage of model data and overall system (#395) 2022-03-14 22:05:30 +08:00