2938 Commits (6b69f3085bc3e2145feaf56f5fb237e4df8f368b)

 

All Branches   

Search

Author	SHA1	Message	Date
Xuanlei Zhao	6b69f3085b	update	11 months ago
Xuanlei Zhao	8ca8cf8ec3	update optim	11 months ago
Xuanlei Zhao	f037583bd2	update train	11 months ago
Xuanlei Zhao	0b8c33f474	update	11 months ago
Xuanlei Zhao	c1c6af6368	update	11 months ago
Xuanlei Zhao	0bb317d9e6	update	11 months ago
Xuanlei Zhao	ccad7014c6	update optim	11 months ago
Xuanlei Zhao	44014faa67	fix optim	11 months ago
Xuanlei Zhao	0a3aae509b	update utils and fwd bwd	11 months ago
Xuanlei Zhao	a5580e6289	update test	11 months ago
Xuanlei Zhao	73aa406b96	update	11 months ago
Xuanlei Zhao	570f5cd693	update pytest	11 months ago
Xuanlei Zhao	54b197cc02	update readme	11 months ago
Xuanlei Zhao	4922641098	script	11 months ago
Xuanlei Zhao	d660a41850	update	11 months ago
Xuanlei Zhao	b8fadb68a7	add pad	11 months ago
Xuanlei Zhao	23341687ed	update	11 months ago
Xuanlei Zhao	aa2e091dc6	update	11 months ago
Xuanlei Zhao	7c5b1a585f	update	11 months ago
Xuanlei Zhao	ebd8cc579a	update script	12 months ago
Xuanlei Zhao	f66469e209	update	12 months ago
Xuanlei Zhao	8aef2dba02	init	12 months ago
flybird11111	79718fae04	[shardformer] llama support DistCrossEntropy (#5176) ... * fix aaa fix fix fix * fix * fix * test ci * fix ci fix * llama support dist-cross fix fix fix fix fix fix fix fix * fix * fix * fix fix * test ci * test ci * fix * [Colossal-Llama-2] Add finetuning Colossal-Llama-2 example (#4878) * Add finetuning Colossal-Llama-2 example * Add finetuning Colossal-Llama-2 example 2 * Add finetuning Colossal-Llama-2 example and support NEFTuning * Add inference example and refine neftune * Modify readme file * update the imports --------- Co-authored-by: Xu Yuanchen <yuanchen.xu00@gmail.com> Co-authored-by: Camille Zhong <44392324+Camille7777@users.noreply.github.com> * llama support dist-cross fix fix fix fix fix fix fix fix * fix * fix * fix fix * test ci * test ci * fix * fix ci * fix ci --------- Co-authored-by: Yuanchen <70520919+chengeharrison@users.noreply.github.com> Co-authored-by: Xu Yuanchen <yuanchen.xu00@gmail.com> Co-authored-by: Camille Zhong <44392324+Camille7777@users.noreply.github.com>	12 months ago
Yuanchen	cefdc32615	[ColossalEval] Support GSM, Data Leakage Evaluation and Tensor Parallel (#5169) ... * Support GSM, Data Leakage Evaluation and Tensor Parallel * remove redundant code and update inference.py in examples/gpt_evaluation --------- Co-authored-by: Xu Yuanchen <yuanchen.xu00@gmail.com>	12 months ago
Michelle	b07a6f4e27	[colossalqa] fix pangu api (#5170) ... * fix pangu api * add comment	12 months ago
flybird11111	21aa5de00b	[gemini] hotfix NaN loss while using Gemini + tensor_parallel (#5150) ... * fix aaa fix fix fix * fix * fix * test ci * fix ci fix	12 months ago
Yuanchen	b397104438	[Colossal-Llama-2] Add finetuning Colossal-Llama-2 example (#4878) ... * Add finetuning Colossal-Llama-2 example * Add finetuning Colossal-Llama-2 example 2 * Add finetuning Colossal-Llama-2 example and support NEFTuning * Add inference example and refine neftune * Modify readme file * update the imports --------- Co-authored-by: Xu Yuanchen <yuanchen.xu00@gmail.com> Co-authored-by: Camille Zhong <44392324+Camille7777@users.noreply.github.com>	12 months ago
flybird11111	3dbbf83f1c	fix (#5158) ... fix	12 months ago
Michelle	368b5e3d64	[doc] fix colossalqa document (#5146) ... * fix doc * modify doc	12 months ago
Michelle	c7fd9a5213	[ColossalQA] refactor server and webui & add new feature (#5138) ... * refactor server and webui & add new feature * add requirements * modify readme and ui	1 year ago
flybird11111	2a2ec49aa7	[plugin]fix 3d checkpoint load when booster boost without optimizer. (#5135) ... * fix 3d checkpoint load when booster boost without optimizer fix 3d checkpoint load when booster boost without optimizer * test ci * revert ci * fix fix	1 year ago
github-actions[bot]	f6731db67c	[format] applied code formatting on changed files in pull request 5115 (#5118) ... Co-authored-by: github-actions <github-actions@github.com>	1 year ago
github-actions[bot]	9b36640f28	[format] applied code formatting on changed files in pull request 5124 (#5125) ... Co-authored-by: github-actions <github-actions@github.com>	1 year ago
github-actions[bot]	d10ee42f68	[format] applied code formatting on changed files in pull request 5088 (#5127) ... Co-authored-by: github-actions <github-actions@github.com>	1 year ago
digger yu	9110406a47	fix typo change JOSNL TO JSONL etc. (#5116)	1 year ago
Frank Lee	2899cfdabf	[doc] updated paper citation (#5131)	1 year ago
binmakeswell	177c79f2d1	[doc] add moe news (#5128) ... * [doc] add moe news * [doc] add moe news * [doc] add moe news	1 year ago
Wenhao Chen	7172459e74	[shardformer]: support gpt-j, falcon, Mistral and add interleaved pipeline for bert (#5088) ... * [shardformer] implement policy for all GPT-J models and test * [shardformer] support interleaved pipeline parallel for bert finetune * [shardformer] shardformer support falcon (#4883) * [shardformer]: fix interleaved pipeline for bert model (#5048) * [hotfix]: disable seq parallel for gptj and falcon, and polish code (#5093) * Add Mistral support for Shardformer (#5103) * [shardformer] add tests to mistral (#5105) --------- Co-authored-by: Pengtai Xu <henryxu880@gmail.com> Co-authored-by: ppt0011 <143150326+ppt0011@users.noreply.github.com> Co-authored-by: flybird11111 <1829166702@qq.com> Co-authored-by: eric8607242 <e0928021388@gmail.com>	1 year ago
アマデウス	126cf180bc	[hotfix] fixed memory usage of shardformer module replacement (#5122)	1 year ago
Zian(Andy) Zheng	7b789f4dd2	[FEATURE] Add Safety Eval Datasets to ColossalEval (#5095) ... * add safetybench and cvalues(responsibility) eval dataset * Modify code according to review suggestions --------- Co-authored-by: Orion-Zheng <zhengzian@u.nus.edu>	1 year ago
digger yu	d5661f0f25	[nfc] fix typo change directoty to directory (#5111)	1 year ago
digger yu	2bdf76f1f2	fix typo change lazy_iniy to lazy_init (#5099)	1 year ago
Xuanlei Zhao	68fcaa2225	remove duplicate import (#5100)	1 year ago
YeAnbang	e53e729d8e	[Feature] Add document retrieval QA (#5020) ... * add langchain * add langchain * Add files via upload * add langchain * fix style * fix style: remove extra space * add pytest; modified retriever * add pytest; modified retriever * add tests to build_on_pr.yml * fix build_on_pr.yml * fix build on pr; fix environ vars * seperate unit tests for colossalqa from build from pr * fix container setting; fix environ vars * commented dev code * add incremental update * remove stale code * fix style * change to sha3 224 * fix retriever; fix style; add unit test for document loader * fix ci workflow config * fix ci workflow config * add set cuda visible device script in ci * fix doc string * fix style; update readme; refactored * add force log info * change build on pr, ignore colossalqa * fix docstring, captitalize all initial letters * fix indexing; fix text-splitter * remove debug code, update reference * reset previous commit * update LICENSE update README add key-value mode, fix bugs * add files back * revert force push * remove junk file * add test files * fix retriever bug, add intent classification * change conversation chain design * rewrite prompt and conversation chain * add ui v1 * ui v1 * fix atavar * add header * Refactor the RAG Code and support Pangu * Refactor the ColossalQA chain to Object-Oriented Programming and the UI demo. * resolved conversation. tested scripts under examples. web demo still buggy * fix ci tests * Some modifications to add ChatGPT api * modify llm.py and remove unnecessary files * Delete applications/ColossalQA/examples/ui/test_frontend_input.json * Remove OpenAI api key * add colossalqa * move files * move files * move files * move files * fix style * Add Readme and fix some bugs. * Add something to readme and modify some code * modify a directory name for clarity * remove redundant directory * Correct a type in llm.py * fix AI prefix * fix test_memory.py * fix conversation * fix some erros and typos * Fix a missing import in RAG_ChatBot.py * add colossalcloud LLM wrapper, correct issues in code review --------- Co-authored-by: YeAnbang <anbangy2@outlook.com> Co-authored-by: Orion-Zheng <zheng_zian@u.nus.edu> Co-authored-by: Zian(Andy) Zheng <62330719+Orion-Zheng@users.noreply.github.com> Co-authored-by: Orion-Zheng <zhengzian@u.nus.edu>	1 year ago
Xuanlei Zhao	3acbf6d496	[npu] add npu support for hybrid plugin and llama (#5090) ... * llama 3d * update * fix autocast	1 year ago
flybird11111	aae496631c	[shardformer]fix flash attention, when mask is casual, just don't unpad it (#5084) ... * fix flash attn * fix fix	1 year ago
Zhongkai Zhao	75af66cd81	[Hotfix] Fix model policy matching strategy in ShardFormer (#5064) ... * hotfix/Fix get model policy strategy in ShardFormer * fix bug in auto policy	1 year ago
flybird11111	4ccb9ded7d	[gemini]fix gemini optimzer, saving Shardformer in Gemini got list assignment index out of range (#5085)	1 year ago
digger yu	0d482302a1	[nfc] fix typo and author name (#5089)	1 year ago
digger yu	fd3567e089	[nfc] fix typo in docs/ (#4972)	1 year ago