Commit Graph

3528 Commits (37443cc7e499aa836d4897bf51b1119815da45b3)
 

Author SHA1 Message Date
Runyu Lu 6e30248683 [fix] tmp for test
9 months ago
xs_courtesy 388e043930 add implementatino for GetGPULaunchConfig1D
9 months ago
Runyu Lu d02e257abd
Merge branch 'feature/colossal-infer' into colossal-infer-cuda-graph
9 months ago
Runyu Lu ae24b4f025 diverse tests
9 months ago
Runyu Lu 1821a6dab0 [fix] pytest and fix dyn grid bug
9 months ago
yuehuayingxueluo f366a5ea1f
[Inference/kernel]Add Fused Rotary Embedding and KVCache Memcopy CUDA Kernel (#5418)
9 months ago
Steve Luo ed431de4e4
fix rmsnorm template function invocation problem(template function partial specialization is not allowed in Cpp) and luckily pass e2e precision test (#5454)
9 months ago
Hongxin Liu f2e8b9ef9f
[devops] fix compatibility (#5444)
9 months ago
傅剑寒 6fd355a5a6
Merge pull request #5452 from Courtesy-Xs/fix_include_path
9 months ago
xs_courtesy c1c45e9d8e fix include path
9 months ago
Steve Luo b699f54007
optimize rmsnorm: add vectorized elementwise op, feat loop unrolling (#5441)
9 months ago
傅剑寒 368a2aa543
Merge pull request #5445 from Courtesy-Xs/refactor_infer_compilation
9 months ago
digger yu 385e85afd4
[hotfix] fix typo s/keywrods/keywords etc. (#5429)
9 months ago
xs_courtesy 095c070a6e refactor code
9 months ago
Camille Zhong da885ed540
fix tensor data update for gemini loss caluculation (#5442)
9 months ago
傅剑寒 21e1e3645c
Merge pull request #5435 from Courtesy-Xs/add_gpu_launch_config
9 months ago
Runyu Lu 633e95b301 [doc] add doc
9 months ago
Runyu Lu 9dec66fad6 [fix] multi graphs capture error
9 months ago
Runyu Lu b2c0d9ff2b [fix] multi graphs capture error
9 months ago
Steve Luo f7aecc0c6b
feat rmsnorm cuda kernel and add unittest, benchmark script (#5417)
9 months ago
xs_courtesy 5eb5ff1464 refactor code
9 months ago
xs_courtesy 01d289d8e5 Merge branch 'feature/colossal-infer' of https://github.com/hpcaitech/ColossalAI into add_gpu_launch_config
9 months ago
xs_courtesy a46598ac59 add reusable utils for cuda
9 months ago
傅剑寒 2b28b54ac6
Merge pull request #5433 from Courtesy-Xs/add_silu_and_mul
9 months ago
Runyu Lu cefaeb5fdd [feat] cuda graph support and refactor non-functional api
9 months ago
Hongxin Liu 8020f42630
[release] update version (#5411)
9 months ago
xs_courtesy 95c21498d4 add silu_and_mul for infer
9 months ago
Camille Zhong 743e7fad2f
[colossal-llama2] add stream chat examlple for chat version model (#5428)
9 months ago
Youngon 68f55a709c
[hotfix] fix stable diffusion inference bug. (#5289)
9 months ago
hugo-syn c8003d463b
[doc] Fix typo s/infered/inferred/ (#5288)
9 months ago
digger yu 5e1c93d732
[hotfix] fix typo change MoECheckpintIO to MoECheckpointIO (#5335)
9 months ago
Dongruixuan Li a7ae2b5b4c
[eval-hotfix] set few_shot_data to None when few shot is disabled (#5422)
9 months ago
digger yu 049121d19d
[hotfix] fix typo change enabel to enable under colossalai/shardformer/ (#5317)
9 months ago
digger yu 16c96d4d8c
[hotfix] fix typo change _descrption to _description (#5331)
9 months ago
digger yu 70cce5cbed
[doc] update some translations with README-zh-Hans.md (#5382)
9 months ago
Luo Yihang e239cf9060
[hotfix] fix typo of openmoe model source (#5403)
9 months ago
MickeyCHAN e304e4db35
[hotfix] fix sd vit import error (#5420)
9 months ago
Hongxin Liu 070df689e6
[devops] fix extention building (#5427)
9 months ago
binmakeswell 822241a99c
[doc] sora release (#5425)
9 months ago
flybird11111 29695cf70c
[example]add gpt2 benchmark example script. (#5295)
9 months ago
Frank Lee 593a72e4d5
Merge pull request #5424 from FrankLeeeee/sync/main
9 months ago
FrankLeeeee 0310b76e9d Merge branch 'main' into sync/main
9 months ago
Camille Zhong 4b8312c08e
fix sft single turn inference example (#5416)
9 months ago
binmakeswell a1c6cdb189 [doc] fix blog link
9 months ago
binmakeswell 5de940de32 [doc] fix blog link
9 months ago
Frank Lee 2461f37886
[workflow] added pypi channel (#5412)
9 months ago
Tong Li a28c971516
update requirements (#5407)
9 months ago
yuehuayingxueluo 0aa27f1961
[Inference]Move benchmark-related code to the example directory. (#5408)
9 months ago
yuehuayingxueluo 600881a8ea
[Inference]Add CUDA KVCache Kernel (#5406)
9 months ago
flybird11111 0a25e16e46
[shardformer]gather llama logits (#5398)
9 months ago