3491 Commits (73494de57773cfc804f729234bf3611b65f13447)
 

Author SHA1 Message Date
YeAnbang 4b59d874df Merge branch 'main' of https://github.com/hpcaitech/ColossalAI into main 5 months ago
YeAnbang 82aecd6374 add SimPO 5 months ago
binmakeswell 7266f82d03
[doc] fix open sora model weight link (#5848) 5 months ago
binmakeswell 8f445729a4
[doc] opensora v1.2 news (#5846) 5 months ago
botbw 8a5c86439a
[gemini] fix missing return (#5845) 5 months ago
Hongxin Liu bd3e34fef6
[release] update version (#5833) 5 months ago
Yuanheng Zhao 7b249c76e5
[Fix] Fix spec-dec Glide LlamaModel for compatibility with transformers (#5837) 5 months ago
Guangyao Zhang fd1dc417d8
[shardformer] Change atol in test command-r weight-check to pass pytest (#5835) 5 months ago
Guangyao Zhang 2014cce870
[devops] Remove building on PR when edited to avoid skip issue (#5836) 5 months ago
Kai Lv 0adca5b688
[launch] Support IPv4 host initialization in launch (#5822) 5 months ago
Guangyao Zhang 639394b0d4
Merge pull request #5818 from GuangyaoZhang/command-r 5 months ago
Edenzzzz 7f9ec599be
[misc] Add dist optim to doc sidebar (#5806) 5 months ago
GuangyaoZhang 4adbc36913 Merge branch 'command-r' of github.com:GuangyaoZhang/ColossalAI into command-r 5 months ago
GuangyaoZhang d84d68601a change 'xxx if xxx else None' to 'xxx or None' 5 months ago
pre-commit-ci[bot] 996c65077e [pre-commit.ci] auto fixes from pre-commit.com hooks 5 months ago
GuangyaoZhang a83a2336e8 rebase master llama change 5 months ago
GuangyaoZhang 20c0b06ff5 Merge branch 'command-r' of github.com:GuangyaoZhang/ColossalAI into command-r 5 months ago
GuangyaoZhang 363cde6957 merge model and attention forward 5 months ago
GuangyaoZhang 7a2b08646f Remove CohereLayerNorm and use existing layernorm 5 months ago
GuangyaoZhang fe2e74c03a fix precommit 5 months ago
GuangyaoZhang 98da648a4a Fix Code Factor check 5 months ago
GuangyaoZhang f656d61778 change command 5 months ago
GuangyaoZhang 0b81163bc0 Copy llama to command 5 months ago
Edenzzzz 8795bb2e80
Support 4d parallel + flash attention (#5789) 5 months ago
GuangyaoZhang 3c7302ad0e merge model and attention forward 5 months ago
GuangyaoZhang 8c3f524660 Remove CohereLayerNorm and use existing layernorm 5 months ago
GuangyaoZhang c9025ebd7c Merge branch 'command-r' of github.com:GuangyaoZhang/ColossalAI into command-r 5 months ago
GuangyaoZhang 9a290ab013 fix precommit 5 months ago
pre-commit-ci[bot] 2a7fa2e7d0 [pre-commit.ci] auto fixes from pre-commit.com hooks 5 months ago
GuangyaoZhang 1016bb3257 Fix Code Factor check 5 months ago
GuangyaoZhang 94fbde6055 change command 5 months ago
GuangyaoZhang 431b7bcf8f Copy llama to command 5 months ago
flybird11111 2ddf624a86
[shardformer] upgrade transformers to 4.39.3 (#5815) 5 months ago
botbw 3bcbba9262
[gemini] quick fix on possible async operation (#5803) 5 months ago
Haze188 d9dddf574f
[Gemini] Use async stream to prefetch and h2d data moving (#5781) 5 months ago
Li Xingjian 8554585a5f
[Inference] Fix flash-attn import and add model test (#5794) 5 months ago
Guangyao Zhang aac941ef78
[test] fix qwen2 pytest distLarge (#5797) 5 months ago
Hongxin Liu aa125bcc91
[shardformer] fix modeling of bloom and falcon (#5796) 5 months ago
Hongxin Liu 587bbf4c6d
[test] fix chatglm test kit (#5793) 5 months ago
YeAnbang 74f4a29734
Merge pull request #5759 from hpcaitech/colossalchat_upgrade 5 months ago
Runyu Lu c0948aff97
[Inference]refactor baichuan (#5791) 5 months ago
YeAnbang 84eab13078 update sft trainning script 5 months ago
Li Xingjian 77a219a082
Merge pull request #5771 from char-1ee/refactor/modeling 6 months ago
char-1ee b303976a27 Fix test import 6 months ago
YeAnbang 2abdede1d7 fix readme 6 months ago
char-1ee f5981e808e Remove flash attention backend 6 months ago
YeAnbang 77db21610a replace the customized dataloader setup with the build-in one 6 months ago
YeAnbang 0d7ff10ea5 replace the customized dataloader setup with the build-in one 6 months ago
char-1ee ceba662d22 Clean up 6 months ago
char-1ee 5f398fc000 Pass inference model shard configs for module init 6 months ago