ColossalAI/colossalai/zero/low_level/bookkeeping
littsk 83b52c56cd
[feature] Add clip_grad_norm for hybrid_parallel_plugin (#4837)
* Add clip_grad_norm for hibrid_parallel_plugin

* polish code

* add unittests

* Move tp to a higher-level optimizer interface.

* bug fix

* polish code
2023-10-12 11:32:37 +08:00
..
__init__.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
base_store.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
bucket_store.py [hotfix] Correct several erroneous code comments (#4794) 2023-09-27 10:43:03 +08:00
gradient_store.py [feature] Add clip_grad_norm for hybrid_parallel_plugin (#4837) 2023-10-12 11:32:37 +08:00
parameter_store.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
tensor_bucket.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00