You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
ColossalAI/colossalai/engine/ophooks
Jiarui Fang 214da761d4
[zero] add stateful tensor (#549)
3 years ago
..
__init__.py [zero] adapt for no-leaf module in zero (#535) 3 years ago
_base_ophook.py add pytorch hooks (#179) 3 years ago
_memtracer_ophook.py Refactored docstring to google style 3 years ago
_shard_grad_ophook.py [zero] add sharded grad and refactor grad hooks for ShardedModel (#287) 3 years ago
_shard_param_ophook.py fix sharded param hook and unit test 3 years ago
zero_hook.py [zero] add stateful tensor (#549) 3 years ago