mirror of https://github.com/hpcaitech/ColossalAI
a30e2b4c24
only process module's own parameters in Zero context add zero hooks for all modules that contrain parameters gather parameters only belonging to module itself |
||
---|---|---|
.. | ||
__init__.py | ||
_base_ophook.py | ||
_memtracer_ophook.py | ||
_shard_grad_ophook.py | ||
_shard_param_ophook.py | ||
zero_hook.py |