mirror of https://github.com/hpcaitech/ColossalAI
3420921101
* [Feature] deepseek moe expert parallel implement * [misc] fix typo, remove redundant file (#5867) * [misc] fix typo * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci --------- Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> * [Feature] deepseek support & unit test * [misc] remove debug code & useless print * [misc] fix typos (#5872) * [Feature] remove modeling file, use auto config. (#5884) * [misc] fix typos * [Feature] deepseek support via auto model, remove modeling file * [misc] delete useless file * [misc] fix typos * [Deepseek] remove redundant code (#5888) * [misc] fix typos * [Feature] deepseek support via auto model, remove modeling file * [misc] delete useless file * [misc] fix typos * [misc] remove redundant code * [Feature/deepseek] resolve comment. (#5889) * [misc] fix typos * [Feature] deepseek support via auto model, remove modeling file * [misc] delete useless file * [misc] fix typos * [misc] remove redundant code * [misc] mv module replacement into if branch * [misc] add some warning message and modify some code in unit test * [misc] fix typos --------- Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> |
||
|---|---|---|
| .. | ||
| chatglm2_6b | ||
| __init__.py | ||
| bert.py | ||
| blip2.py | ||
| bloom.py | ||
| chatglm2.py | ||
| command.py | ||
| deepseek.py | ||
| falcon.py | ||
| gpt2.py | ||
| gptj.py | ||
| jit.py | ||
| llama.py | ||
| mistral.py | ||
| mixtral.py | ||
| opt.py | ||
| qwen2.py | ||
| sam.py | ||
| t5.py | ||
| vit.py | ||
| whisper.py | ||