mirror of https://github.com/hpcaitech/ColossalAI
83b52c56cd
* Add clip_grad_norm for hibrid_parallel_plugin * polish code * add unittests * Move tp to a higher-level optimizer interface. * bug fix * polish code |
||
---|---|---|
.. | ||
__init__.py | ||
base_store.py | ||
bucket_store.py | ||
gradient_store.py | ||
parameter_store.py | ||
tensor_bucket.py |