mirror of https://github.com/hpcaitech/ColossalAI
a3cc68ca93
* feat: support qwen2 model * fix: modify model config and add Qwen2RMSNorm * fix qwen2 model conflicts * test: add qwen2 shard test * to: add qwen2 auto policy * support qwen model * fix the conflicts * add try catch * add transformers version for qwen2 * add the ColoAttention for the qwen2 model * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * add the unit test version check * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * fix the test input bug * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * fix the version check * fix the version check --------- Co-authored-by: Wenhao Chen <cwher@outlook.com> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> |
||
|---|---|---|
| .. | ||
| kit | ||
| test_analyzer | ||
| test_auto_parallel | ||
| test_autochunk | ||
| test_booster | ||
| test_checkpoint_io | ||
| test_cluster | ||
| test_config | ||
| test_device | ||
| test_fx | ||
| test_gptq | ||
| test_infer | ||
| test_lazy | ||
| test_legacy | ||
| test_lora | ||
| test_moe | ||
| test_optimizer | ||
| test_pipeline | ||
| test_shardformer | ||
| test_smoothquant | ||
| test_tensor | ||
| test_zero | ||
| __init__.py | ||