mirror of https://github.com/hpcaitech/ColossalAI
014bac0c49
* hijack p.grad in sharded model * polish comments * polish comments |
||
---|---|---|
.. | ||
__init__.py | ||
_base_ophook.py | ||
_memtracer_ophook.py | ||
_shard_grad_ophook.py | ||
_shard_param_ophook.py | ||
zero_hook.py |