mirror of https://github.com/hpcaitech/ColossalAI
2fc85abf43
* [gemini] async grad chunk reduce (all-reduce&reduce-scatter) * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * [gemini] add test * [gemini] rename func * [gemini] update llama benchmark * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * [gemini] use tensor counter * [gemini] change default config in GeminiPlugin and GeminiDDP * [chore] typo * [gemini] fix sync issue & add test cases * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci --------- Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> |
||
|---|---|---|
| .. | ||
| bert | ||
| commons | ||
| gpt | ||
| grok-1 | ||
| llama | ||
| openmoe | ||
| opt | ||
| palm | ||
| __init__.py | ||
| data_utils.py | ||
| model_utils.py | ||
| performance_evaluator.py | ||