ColossalAI/colossalai/engine/ophooks
Jiarui Fang 10e2826426 move async memory to an individual directory (#345) 2022-03-11 15:50:28 +08:00
..
__init__.py [zero] Update sharded model v2 using sharded param v2 (#323) 2022-03-11 15:50:28 +08:00
_base_ophook.py add pytorch hooks (#179) 2022-01-25 22:20:54 +08:00
_memtracer_ophook.py move async memory to an individual directory (#345) 2022-03-11 15:50:28 +08:00
_shard_grad_ophook.py [zero] add sharded grad and refactor grad hooks for ShardedModel (#287) 2022-03-11 15:50:28 +08:00
_shard_param_ophook.py fix sharded param hook and unit test 2022-03-11 15:50:28 +08:00
zero_hook.py [zero] Update sharded model v2 using sharded param v2 (#323) 2022-03-11 15:50:28 +08:00