Branch: colossalchat_upgrade

ColossalChat

ckpt

cloud/coati

colossalchat

colossalchat_upgrade

dev/gpt2_metainfo_patch

dev/zero-offload

develop

feat/moe

feat/online-serving

feat/speculative-decoding

feature/2-stage

feature/async-io

feature/colossal-infer

feature/elixir

feature/inference-refactor

feature/lora

feature/stable-diffusion

feature/zerobubble

fix-setup

fix/format

flybird11111-patch-1

hotfix/example_test

hotfix/kernel_build_before_load

llama3

main

moe_sp

pre-commit-ci-update-config

refactor/inference

supercooledith-patch-1

support-npu

v0.0.1-beta

v0.0.2

v0.1.0

v0.1.1

v0.1.10

v0.1.11rc1

v0.1.11rc2

v0.1.11rc3

v0.1.11rc4

v0.1.11rc5

v0.1.12

v0.1.13

v0.1.2

v0.1.3

v0.1.4

v0.1.5

v0.1.6

v0.1.7

v0.1.8

v0.1.9

v0.2.0

v0.2.1

v0.2.2

v0.2.3

v0.2.4

v0.2.5

v0.2.6

v0.2.7

v0.2.8

v0.3.0

v0.3.1

v0.3.2

v0.3.3

v0.3.4

v0.3.5

v0.3.6

v0.3.7

v0.3.8

v0.3.9

v0.4.0

v0.4.1

v0.4.2

v0.4.3

v0.4.4

v0.4.5

v0.4.6

Branches Tags

${ item.name }

Create tag ${ searchTerm }

Create branch ${ searchTerm }

from 'colossalchat_upgrade'

${ noResults }

Commit Graph

3394 Commits (colossalchat_upgrade)

 

All Branches   

Search

Author	SHA1	Message	Date
YeAnbang	82aecd6374	add SimPO	5 months ago
YeAnbang	84eab13078	update sft trainning script	5 months ago
YeAnbang	2abdede1d7	fix readme	5 months ago
YeAnbang	77db21610a	replace the customized dataloader setup with the build-in one	6 months ago
YeAnbang	0d7ff10ea5	replace the customized dataloader setup with the build-in one	6 months ago
YeAnbang	790e1362a6	merge	6 months ago
YeAnbang	ac1520cb8f	remove baichuan from template test due to transformer version conflict	6 months ago
YeAnbang	e16ccc272a	update ci	6 months ago
YeAnbang	45195ac53d	remove local data path	6 months ago
YeAnbang	bf57b13dda	remove models that require huggingface auth from ci	6 months ago
YeAnbang	0bbac158ed	fix datasets version	6 months ago
YeAnbang	62eb28b929	remove duplicated test	6 months ago
YeAnbang	b8b5cacf38	fix transformers version	6 months ago
pre-commit-ci[bot]	1b880ce095	[pre-commit.ci] auto fixes from pre-commit.com hooks ... for more information, see https://pre-commit.ci	6 months ago
YeAnbang	b1031f7244	fix ci	6 months ago
YeAnbang	7ae87b3159	fix training script	6 months ago
YeAnbang	0b4a33548c	moupdate ci tests, st ci test cases passed, tp failed in generation for ppo, sp is buggy	6 months ago
YeAnbang	7e65b71815	run pre-commit	6 months ago
YeAnbang	929e1e3da4	upgrade ppo dpo rm script	6 months ago
YeAnbang	7a7e86987d	upgrade colossal-chat support tp_group>1, add sp for sft	6 months ago
Hongxin Liu	73e88a5553	[shardformer] fix import (#5788)	6 months ago
Hongxin Liu	5ead00ffc5	[misc] update requirements (#5787)	6 months ago
flybird11111	a1e39f4c0d	[install]fix setup (#5786) ... * fix * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci --------- Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>	6 months ago
Hongxin Liu	b9d646fe9e	[misc] fix dist logger (#5782)	6 months ago
Charles Coulombe	c46e09715c	Allow building cuda extension without a device. (#5535) ... Added FORCE_CUDA environment variable support, to enable building extensions where a GPU device is not present but cuda libraries are.	6 months ago
botbw	3f7e3131d9	[gemini] optimize reduce scatter d2h copy (#5760) ... * [gemini] optimize reduce scatter d2h copy * [fix] fix missing reduce variable * [refactor] remove legacy async reduce scatter code * [gemini] missing sync * Revert "[refactor] remove legacy async reduce scatter code" This reverts commit 58ad76d466. * [gemini] further optimize with async all reduce * [fix] pass flag from manager to chunk	6 months ago
duanjunwen	10a19e22c6	[hotfix] fix testcase in test_fx/test_tracer (#5779) ... * [fix] branch for fix testcase; * [fix] fix test_analyzer & test_auto_parallel; * [fix] remove local change about moe; * [fix] rm local change moe; * [fix] fix test_deepfm_model & test_dlrf_model； * [fix] fix test_hf_albert & test_hf_gpt;	6 months ago
botbw	80c3c8789b	[Test/CI] remove test cases to reduce CI duration (#5753) ... * [test] smaller gpt2 test case * [test] reduce test cases: tests/test_zero/test_gemini/test_zeroddp_state_dict.py * [test] reduce test cases: tests/test_zero/test_gemini/test_grad_accum.py * [test] reduce test cases tests/test_zero/test_gemini/test_optim.py * Revert "[test] smaller gpt2 test case" Some tests might depend on the size of model (num of chunks) This reverts commit df705a5210. * [test] reduce test cases: tests/test_checkpoint_io/test_gemini_checkpoint_io.py * [CI] smaller test model for two mwo the two modifid cases * [CI] hardcode gpt model for tests/test_zero/test_gemini/test_search.py since we need a fixed answer there	6 months ago
Edenzzzz	79f7a7b211	[misc] Accelerate CI for zero and dist optim (#5758) ... * remove fp16 from lamb * remove d2h copy in checking states --------- Co-authored-by: Edenzzzz <wtan45@wisc.edu>	6 months ago
flybird11111	50b4c8e8cf	[hotfix] fix llama flash attention forward (#5777)	6 months ago
yuehuayingxueluo	b45000f839	[Inference]Add Streaming LLM (#5745) ... * Add Streaming LLM * add some parameters to llama_generation.py * verify streamingllm config * add test_streamingllm.py * modified according to the opinions of review * add Citation * change _block_tables tolist	6 months ago
Hongxin Liu	ee6fd38373	[devops] fix docker ci (#5780)	6 months ago
Hongxin Liu	32f4187806	[misc] update dockerfile (#5776) ... * [misc] update dockerfile * [misc] update dockerfile	6 months ago
Haze188	e22b82755d	[CI/tests] simplify some test case to reduce testing time (#5755) ... * [ci/tests] simplify some test case to reduce testing time * [ci/tests] continue to remove test case to reduce ci time cost * restore some test config * [ci/tests] continue to reduce ci time cost	6 months ago
Yuanheng Zhao	406443200f	[Hotfix] Add missing init file in inference.executor (#5774)	6 months ago
duanjunwen	1b76564e16	[test] Fix/fix testcase (#5770) ... * [fix] branch for fix testcase; * [fix] fix test_analyzer & test_auto_parallel; * [fix] remove local change about moe; * [fix] rm local change moe;	6 months ago
flybird11111	3f2be80530	fix (#5765)	6 months ago
Hongxin Liu	68359ed1e1	[release] update version (#5752) ... * [release] update version * [devops] update compatibility test * [devops] update compatibility test * [devops] update compatibility test * [devops] update compatibility test * [test] fix ddp plugin test * [test] fix gptj and rpc test * [devops] fix cuda ext compatibility * [inference] fix flash decoding test * [inference] fix flash decoding test	6 months ago
Yuanheng Zhao	677cbfacf8	[Fix/Example] Fix Llama Inference Loading Data Type (#5763) ... * [fix/example] fix llama inference loading dtype * revise loading dtype of benchmark llama3	6 months ago
botbw	023ea13cb5	Merge pull request #5749 from hpcaitech/prefetch ... [Gemini] Prefetch next chunk before each op	6 months ago
hxwang	154720ba6e	[chore] refactor profiler utils	6 months ago
hxwang	8547562884	[chore] remove unnecessary assert since compute list might not be recorded	6 months ago
hxwang	e5e3320948	[bug] continue fix	6 months ago
hxwang	936dd96dbb	[bug] workaround for idx fix	6 months ago
botbw	e0dde8fda5	Merge pull request #5754 from Hz188/prefetch ... [Gemini]Prefetch benchmark	6 months ago
botbw	157b4cc357	Merge branch 'prefetch' into prefetch	6 months ago
genghaozhe	87665d7922	correct argument help message	6 months ago
Haze188	4d097def96	[Gemini] add some code for reduce-scatter overlap, chunk prefetch in llama benchmark. (#5751) ... * [bugs] fix args.profile=False DummyProfiler errro * add args.prefetch_num for benchmark	6 months ago
genghaozhe	b9269d962d	add args.prefetch_num for benchmark	6 months ago
genghaozhe	fba04e857b	[bugs] fix args.profile=False DummyProfiler errro	6 months ago