2315 Commits (f83ea813f5bb6ecc5597c7f1bf97870d46de1c49)

 

All Branches   

Search

Author	SHA1	Message	Date
Hongxin Liu	f83ea813f5	[example] add train resnet/vit with booster example (#3694) ... * [example] add train vit with booster example * [example] update readme * [example] add train resnet with booster example * [example] enable ci * [example] enable ci * [example] add requirements * [hotfix] fix analyzer init * [example] update requirements	2 years ago
YH	2629f9717d	[tensor] Refactor handle_trans_spec in DistSpecManager	2 years ago
zhang-yi-chi	2da5d81dec	[chat] fix train_prompts.py gemini strategy bug (#3666) ... * fix gemini strategy bug * add comment * add comment * better solution	2 years ago
Hongxin Liu	d556648885	[example] add finetune bert with booster example (#3693)	2 years ago
digger-yu	65bdc3159f	fix some spelling error with applications/Chat/examples/ (#3692) ... * fix spelling error with examples/comminity/ * fix spelling error with example/	2 years ago
Hongxin Liu	d0915f54f4	[booster] refactor all dp fashion plugins (#3684) ... * [booster] add dp plugin base * [booster] inherit dp plugin base * [booster] refactor unit tests	2 years ago
digger-yu	b49020c1b1	[CI] Update test_sharded_optim_with_sync_bn.py (#3688) ... fix spelling error in line23 change "cudnn_determinstic"=True to "cudnn_deterministic=True"	2 years ago
Tong Li	b36e67cb2b	Merge pull request #3680 from digger-yu/digger-yu-patch-2 ... fix spelling error with applications/Chat/evaluate/	2 years ago
jiangmingyan	307894f74d	[booster] gemini plugin support shard checkpoint (#3610) ... * gemini plugin add shard checkpoint save/load * gemini plugin add shard checkpoint save/load * gemini plugin add shard checkpoint save/load * gemini plugin add shard checkpoint save/load * gemini plugin add shard checkpoint save/load * gemini plugin add shard checkpoint save/load * gemini plugin add shard checkpoint save/load * gemini plugin add shard checkpoint save/load * gemini plugin add shard checkpoint save/load * gemini plugin add shard checkpoint save/load * gemini plugin add shard checkpoint save/load * gemini plugin add shard checkpoint save/load * gemini plugin add shard checkpoint save/load * gemini plugin add shard checkpoint save/load * gemini plugin support shard checkpoint * [API Refactoring]gemini plugin support shard checkpoint * [API Refactoring]gemini plugin support shard checkpoint * [API Refactoring]gemini plugin support shard checkpoint * [API Refactoring]gemini plugin support shard checkpoint * [API Refactoring]gemini plugin support shard checkpoint * [API Refactoring]gemini plugin support shard checkpoint * [API Refactoring]gemini plugin support shard checkpoint * [API Refactoring]gemini plugin support shard checkpoint * [API Refactoring]gemini plugin support shard checkpoint * [API Refactoring]gemini plugin support shard checkpoint * [API Refactoring]gemini plugin support shard checkpoint * [API Refactoring]gemini plugin support shard checkpoint * [API Refactoring]gemini plugin support shard checkpoint --------- Co-authored-by: luchen <luchen@luchendeMBP.lan> Co-authored-by: luchen <luchen@luchendeMacBook-Pro.local>	2 years ago
Camille Zhong	0f785cb1f3	[chat] PPO stage3 doc enhancement (#3679) ... * Add RoBERTa for RLHF Stage 2 & 3 (test) RoBERTa for RLHF Stage 2 & 3 (still in testing) Revert "Add RoBERTa for RLHF Stage 2 & 3 (test)" This reverts commit 06741d894d. Add RoBERTa for RLHF stage 2 & 3 1. add roberta folder under model folder 2. add roberta option in train_reward_model.py 3. add some test in testci Update test_ci.sh Revert "Update test_ci.sh" This reverts commit 9c7352b81766f3177d31eeec0ec178a301df966a. Add RoBERTa for RLHF Stage 2 & 3 (test) RoBERTa for RLHF Stage 2 & 3 (still in testing) Revert "Add RoBERTa for RLHF Stage 2 & 3 (test)" This reverts commit 06741d894d. Add RoBERTa for RLHF stage 2 & 3 1. add roberta folder under model folder 2. add roberta option in train_reward_model.py 3. add some test in testci Update test_ci.sh Revert "Update test_ci.sh" This reverts commit 9c7352b81766f3177d31eeec0ec178a301df966a. update roberta with coati chat ci update Revert "chat ci update" This reverts commit 17ae7ae01fa752bd3289fc39069868fde99cf846. * Update README.md Update README.md * update readme * Update test_ci.sh * update readme and add a script update readme and add a script modify readme Update README.md	2 years ago
digger-yu	6650daeb0a	[doc] fix chat spelling error (#3671) ... * Update README.md change "huggingaface" to "huggingface" * Update README.md change "Colossa-AI" to "Colossal-AI"	2 years ago
Hongxin Liu	7bd0bee8ea	[chat] add opt attn kernel (#3655) ... * [chat] add opt attn kernel * [chat] disable xformer during fwd	2 years ago
digger-yu	8ba7858753	Update generate_gpt35_answers.py ... fix spelling error with generate_gpt35_answers.py	2 years ago
digger-yu	bfbf650588	fix spelling error ... fix spelling error with evaluate.py	2 years ago
tanitna	1a60dc07a8	[chat] typo accimulation_steps -> accumulation_steps (#3662)	2 years ago
Tong Li	816add7e7f	Merge pull request #3656 from TongLi3701/chat/update_eval ... [Chat]: Remove unnecessary step and update documentation	2 years ago
binmakeswell	268b3cd80d	[chat] set default zero2 strategy (#3667) ... * [chat] set default gemini strategy * [chat] set default zero2 strategy * [chat] set default zero2 strategy	2 years ago
Tong Li	c1a355940e	update readme	2 years ago
Tong Li	ed3eaa6922	update documentation	2 years ago
Tong Li	c419117329	update questions and readme	2 years ago
Tong Li	aa77ddae33	remove unnecessary step and update readme	2 years ago
YH	a22407cc02	[zero] Suggests a minor change to confusing variable names in the ZeRO optimizer. (#3173) ... * Fix confusing variable name in zero opt * Apply lint * Fix util func * Fix minor util func * Fix zero param optimizer name	2 years ago
Hongxin Liu	842768a174	[chat] refactor model save/load logic (#3654) ... * [chat] strategy refactor unwrap model * [chat] strategy refactor save model * [chat] add docstr * [chat] refactor trainer save model * [chat] fix strategy typing * [chat] refactor trainer save model * [chat] update readme * [chat] fix unit test	2 years ago
Hongxin Liu	6ef7011462	[chat] remove lm model class (#3653) ... * [chat] refactor lora * [chat] remove lm class * [chat] refactor save model * [chat] refactor train sft * [chat] fix ci * [chat] fix ci	2 years ago
Camille Zhong	8bccb72c8d	[Doc] enhancement on README.md for chat examples (#3646) ... * Add RoBERTa for RLHF Stage 2 & 3 (test) RoBERTa for RLHF Stage 2 & 3 (still in testing) Revert "Add RoBERTa for RLHF Stage 2 & 3 (test)" This reverts commit 06741d894d. Add RoBERTa for RLHF stage 2 & 3 1. add roberta folder under model folder 2. add roberta option in train_reward_model.py 3. add some test in testci Update test_ci.sh Revert "Update test_ci.sh" This reverts commit 9c7352b81766f3177d31eeec0ec178a301df966a. Add RoBERTa for RLHF Stage 2 & 3 (test) RoBERTa for RLHF Stage 2 & 3 (still in testing) Revert "Add RoBERTa for RLHF Stage 2 & 3 (test)" This reverts commit 06741d894d. Add RoBERTa for RLHF stage 2 & 3 1. add roberta folder under model folder 2. add roberta option in train_reward_model.py 3. add some test in testci Update test_ci.sh Revert "Update test_ci.sh" This reverts commit 9c7352b81766f3177d31eeec0ec178a301df966a. update roberta with coati chat ci update Revert "chat ci update" This reverts commit 17ae7ae01fa752bd3289fc39069868fde99cf846. * Update README.md Update README.md * update readme * Update test_ci.sh	2 years ago
Hongxin Liu	2a951955ad	[chat] refactor trainer (#3648) ... * [chat] ppo trainer remove useless args * [chat] update examples * [chat] update benchmark * [chat] update examples * [chat] fix sft training with wandb * [chat] polish docstr	2 years ago
Hongxin Liu	f8288315d9	[chat] polish performance evaluator (#3647)	2 years ago
Hongxin Liu	50793b35f4	[gemini] accelerate inference (#3641) ... * [gemini] support don't scatter after inference * [chat] update colossalai strategy * [chat] fix opt benchmark * [chat] update opt benchmark * [gemini] optimize inference * [test] add gemini inference test * [chat] fix unit test ci * [chat] fix ci * [chat] fix ci * [chat] skip checkpoint test	2 years ago
Hongxin Liu	4b3240cb59	[booster] add low level zero plugin (#3594) ... * [booster] add low level zero plugin * [booster] fix gemini plugin test * [booster] fix precision * [booster] add low level zero plugin test * [test] fix booster plugin test oom * [test] fix booster plugin test oom * [test] fix googlenet and inception output trans * [test] fix diffuser clip vision model * [test] fix torchaudio_wav2vec2_base * [test] fix low level zero plugin test	2 years ago
digger-yu	b9a8dff7e5	[doc] Fix typo under colossalai and doc(#3618) ... * Fixed several spelling errors under colossalai * Fix the spelling error in colossalai and docs directory * Cautious Changed the spelling error under the example folder * Update runtime_preparation_pass.py revert autograft to autograd * Update search_chunk.py utile to until * Update check_installation.py change misteach to mismatch in line 91 * Update 1D_tensor_parallel.md revert to perceptron * Update 2D_tensor_parallel.md revert to perceptron in line 73 * Update 2p5D_tensor_parallel.md revert to perceptron in line 71 * Update 3D_tensor_parallel.md revert to perceptron in line 80 * Update README.md revert to resnet in line 42 * Update reorder_graph.py revert to indice in line 7 * Update p2p.py revert to megatron in line 94 * Update initialize.py revert to torchrun in line 198 * Update routers.py change to detailed in line 63 * Update routers.py change to detailed in line 146 * Update README.md revert random number in line 402	2 years ago
Tong Li	e1b0a78afa	Merge pull request #3621 from zhang-yi-chi/fix/chat-train-prompts-single-gpu ... [chat] fix single gpu training bug in examples/train_prompts.py	2 years ago
ddobokki	df309fc6ab	[Chat] Remove duplicate functions (#3625)	2 years ago
Hongxin Liu	179558a87a	[devops] fix chat ci (#3628)	2 years ago
zhang-yi-chi	739cfe3360	[chat] fix enable single gpu training bug	2 years ago
digger-yu	d7bf284706	[chat] polish code note typo (#3612)	2 years ago
Yuanchen	c4709d34cf	Chat evaluate (#3608) ... Co-authored-by: Yuanchen Xu <yuanchen.xu00@gmail.com>	2 years ago
digger-yu	633bac2f58	[doc] .github/workflows/README.md (#3605) ... Fixed several word spelling errors change "compatiblity" to "compatibility" etc.	2 years ago
digger-yu	becd3b0f54	[doc] fix setup.py typo (#3603) ... Optimization Code change "vairable" to "variable"	2 years ago
digger-yu	7570d9ae3d	[doc] fix op_builder/README.md (#3597) ... Optimization Code change "requries" to "requires"	2 years ago
Hongxin Liu	12eff9eb4c	[gemini] state dict supports fp16 (#3590) ... * [gemini] save state dict support fp16 * [gemini] save state dict shard support fp16 * [gemini] fix state dict * [gemini] fix state dict	2 years ago
github-actions[bot]	d544ed4345	[bot] Automated submodule synchronization (#3596) ... Co-authored-by: github-actions <github-actions@github.com>	2 years ago
digger-yu	d96567bb5d	[misc] op_builder/builder.py (#3593) ... Optimization Code The source code has not been modified, only a few spelling errors in the comments have been changed	2 years ago
binmakeswell	5a79cffdfd	[coati] fix install cmd (#3592)	2 years ago
Yuanchen	1ec0d386a9	reconstruct chat trainer and fix training script (#3588) ... Co-authored-by: Yuanchen Xu <yuanchen.xu00@gmail.com>	2 years ago
Hongxin Liu	dac127d0ee	[fx] fix meta tensor registration (#3589) ... * [meta] fix torch 1.13.1 * [meta] fix torch 2.0.0 * [meta] fix torch 1.13.0 * [meta] polish code	2 years ago
Camille Zhong	36a519b49f	Update test_ci.sh ... update Update test_ci.sh Update test_ci.sh Update test_ci.sh Update test_ci.sh Update test_ci.sh Update test_ci.sh Update run_chatgpt_examples.yml Update run_chatgpt_examples.yml Update run_chatgpt_examples.yml Update run_chatgpt_examples.yml Update run_chatgpt_examples.yml Update run_chatgpt_examples.yml Update test_ci.sh Update test_ci.sh update Update run_chatgpt_examples.yml Update run_chatgpt_examples.yml update ci Update test_ci.sh Update run_chatgpt_examples.yml Update run_chatgpt_examples.yml Update run_chatgpt_examples.yml Update run_chatgpt_examples.yml Update run_chatgpt_examples.yml Update run_chatgpt_examples.yml Update run_chatgpt_examples.yml Update test_ci.sh Update test_ci.sh Update run_chatgpt_examples.yml Update test_ci.sh Update test_ci.sh Update test_ci.sh update test ci RoBERTa for RLHF Stage 2 & 3 (still in testing) Revert "Add RoBERTa for RLHF Stage 2 & 3 (test)" This reverts commit 06741d894d. Add RoBERTa for RLHF stage 2 & 3 1. add roberta folder under model folder 2. add roberta option in train_reward_model.py 3. add some test in testci Update test_ci.sh Revert "Update test_ci.sh" This reverts commit 9c7352b81766f3177d31eeec0ec178a301df966a. Add RoBERTa for RLHF Stage 2 & 3 (test) RoBERTa for RLHF Stage 2 & 3 (still in testing) Revert "Add RoBERTa for RLHF Stage 2 & 3 (test)" This reverts commit 06741d894d. Add RoBERTa for RLHF stage 2 & 3 1. add roberta folder under model folder 2. add roberta option in train_reward_model.py 3. add some test in testci Update test_ci.sh Revert "Update test_ci.sh" This reverts commit 9c7352b81766f3177d31eeec0ec178a301df966a. update roberta with coati chat ci update Revert "chat ci update" This reverts commit 17ae7ae01fa752bd3289fc39069868fde99cf846. [test]chat_update_ci Update test_ci.sh Update test_ci.sh test Update gpt_critic.py Update gpt_critic.py Update run_chatgpt_unit_tests.yml update test ci update update update update Update test_ci.sh update Update test_ci.sh Update test_ci.sh Update run_chatgpt_examples.yml Update run_chatgpt_examples.yml	2 years ago
digger-yu	d0fbd4b86f	[example] fix community doc (#3586) ... Adjusted the style of Community Examples to be consistent with other titles	2 years ago
Hongxin Liu	f313babd11	[gemini] support save state dict in shards (#3581) ... * [gemini] support state dict shard * [gemini] add test state dict shard * [gemini] polish docstr * [gemini] fix merge * [gemini] polish code	2 years ago
tingfeng cao	7788e0b0a5	fix: fix sft (#3568)	2 years ago
digger-yu	6e7e43c6fe	[doc] Update .github/workflows/README.md (#3577) ... Optimization Code I think there were two extra $ entered here, which have been deleted	2 years ago