mirror of https://github.com/hpcaitech/ColossalAI
9492a561c3
* impl chunk manager * impl param op hook * add reduce_chunk * add zero hook v2 * add zero dp * fix TensorInfo * impl load balancing when using zero without chunk * fix zero hook * polish chunk * fix bugs * ddp ok * zero ok * polish code * fix bugs about load balancing * polish code * polish code * add ene-to-end test * polish code * polish code * polish code * fix typo * add test_chunk * fix bugs * fix bugs * polish code |
||
---|---|---|
.. | ||
__init__.py | ||
zero_hook.py | ||
zero_hook_v2.py |