github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
2,965 Commits
32 Branches
48 Tags
232 MiB
Commit Graph

233 Commits (ea088b5f75e9c9a79d67b370286da2a1508688c8)

Author SHA1 Message Date
Tong Li ea088b5f75 update train code 2024-01-10 10:42:37 +08:00
Tong Li 4b7f273022 add moe 2024-01-09 11:59:38 +08:00
ver217 63ee6fffe6 Merge branch 'main' into exp/mixtral 2024-01-08 16:43:54 +08:00
ver217 ce1cff26bd Merge branch 'main' into exp/mixtral 2024-01-08 16:42:00 +08:00
binmakeswell 7bc6969ce6
[doc] SwiftInfer release (#5236) 
* [doc] SwiftInfer release

* [doc] SwiftInfer release

* [doc] SwiftInfer release

* [doc] SwiftInfer release

* [doc] SwiftInfer release
 2024-01-08 09:55:12 +08:00
github-actions[bot] 4fb4a22a72
[format] applied code formatting on changed files in pull request 5234 (#5235) 
Co-authored-by: github-actions <github-actions@github.com>
 2024-01-07 20:55:34 +08:00
binmakeswell b9b32b15e6
[doc] add Colossal-LLaMA-2-13B (#5234) 
* [doc] add Colossal-LLaMA-2-13B

* [doc] add Colossal-LLaMA-2-13B

* [doc] add Colossal-LLaMA-2-13B
 2024-01-07 20:53:12 +08:00
Camille Zhong 915b4652f3
[doc] Update README.md of Colossal-LLAMA2 (#5233) 
* Update README.md

* Update README.md
 2024-01-06 17:06:41 +08:00
Tong Li d992b55968
[Colossal-LLaMA-2] Release Colossal-LLaMA-2-13b-base model (#5224) 
* update readme

* update readme

* update link

* update

* update readme

* update

* update

* update

* update title

* update example

* update example

* fix content

* add conclusion

* add license

* update

* update

* update version

* fix minor
 2024-01-05 17:24:26 +08:00
Xuanlei Zhao 6b69f3085b update 2024-01-03 15:37:59 +08:00
Xuanlei Zhao 8ca8cf8ec3 update optim 2024-01-03 11:57:23 +08:00
Xuanlei Zhao f037583bd2 update train 2024-01-02 14:01:58 +08:00
Xuanlei Zhao 0b8c33f474 update 2023-12-29 18:20:32 +08:00
Xuanlei Zhao c1c6af6368 update 2023-12-29 18:09:28 +08:00
Xuanlei Zhao 0bb317d9e6 update 2023-12-29 17:28:46 +08:00
Xuanlei Zhao ccad7014c6 update optim 2023-12-29 16:51:29 +08:00
Xuanlei Zhao 44014faa67 fix optim 2023-12-28 21:58:08 +08:00
Xuanlei Zhao 73aa406b96 update 2023-12-28 15:48:04 +08:00
Xuanlei Zhao 570f5cd693 update pytest 2023-12-27 16:05:00 +08:00
Xuanlei Zhao 54b197cc02 update readme 2023-12-26 17:39:38 +08:00
Xuanlei Zhao 4922641098 script 2023-12-26 17:33:32 +08:00
Xuanlei Zhao d660a41850 update 2023-12-26 17:32:59 +08:00
Xuanlei Zhao b8fadb68a7 add pad 2023-12-25 17:02:05 +08:00
Xuanlei Zhao 23341687ed update 2023-12-25 16:29:47 +08:00
Xuanlei Zhao aa2e091dc6 update 2023-12-25 16:05:42 +08:00
Yuanchen eae01b6740
Improve logic for selecting metrics (#5196) 
Co-authored-by: Xu <yuanchen.xu00@gmail.com>
 2023-12-22 14:52:50 +08:00
BlueRum af952673f7
polish readme in application/chat (#5194) 2023-12-20 11:28:39 +08:00
Xuanlei Zhao 7c5b1a585f update 2023-12-18 10:37:07 +08:00
Xuanlei Zhao ebd8cc579a update script 2023-12-15 16:38:51 +08:00
Xuanlei Zhao f66469e209 update 2023-12-15 16:32:32 +08:00
Yuanchen 3ff60d13b0
Fix ColossalEval (#5186) 
Co-authored-by: Xu Yuanchen <yuanchen.xu00@gmail.com>
 2023-12-15 15:06:06 +08:00
Xuanlei Zhao 8aef2dba02 init 2023-12-14 17:52:05 +08:00
Yuanchen cefdc32615
[ColossalEval] Support GSM, Data Leakage Evaluation and Tensor Parallel (#5169) 
* Support GSM, Data Leakage Evaluation and Tensor Parallel

* remove redundant code and update inference.py in examples/gpt_evaluation

---------

Co-authored-by: Xu Yuanchen <yuanchen.xu00@gmail.com>
 2023-12-12 14:47:35 +08:00
Michelle b07a6f4e27
[colossalqa] fix pangu api (#5170) 
* fix pangu api

* add comment
 2023-12-11 14:08:11 +08:00
Yuanchen b397104438
[Colossal-Llama-2] Add finetuning Colossal-Llama-2 example (#4878) 
* Add finetuning Colossal-Llama-2 example

* Add finetuning Colossal-Llama-2 example 2

* Add finetuning Colossal-Llama-2 example and support NEFTuning

* Add inference example and refine neftune

* Modify readme file

* update the imports

---------

Co-authored-by: Xu Yuanchen <yuanchen.xu00@gmail.com>
Co-authored-by: Camille Zhong <44392324+Camille7777@users.noreply.github.com>
 2023-12-07 14:02:03 +08:00
Michelle 368b5e3d64
[doc] fix colossalqa document (#5146) 
* fix doc

* modify doc
 2023-12-01 21:39:53 +08:00
Michelle c7fd9a5213
[ColossalQA] refactor server and webui & add new feature (#5138) 
* refactor server and webui & add new feature

* add requirements

* modify readme and ui
 2023-11-30 22:55:52 +08:00
github-actions[bot] f6731db67c
[format] applied code formatting on changed files in pull request 5115 (#5118) 
Co-authored-by: github-actions <github-actions@github.com>
 2023-11-29 13:39:14 +08:00
digger yu 9110406a47
fix typo change JOSNL TO JSONL etc. (#5116) 2023-11-29 11:08:32 +08:00
Zian(Andy) Zheng 7b789f4dd2 [FEATURE] Add Safety Eval Datasets to ColossalEval (#5095) 
* add safetybench and cvalues(responsibility) eval dataset

* Modify code according to review suggestions

---------

Co-authored-by: Orion-Zheng <zhengzian@u.nus.edu>
 2023-11-28 11:15:04 +08:00
digger yu d5661f0f25
[nfc] fix typo change directoty to directory (#5111) 2023-11-27 18:25:53 +08:00
YeAnbang e53e729d8e
[Feature] Add document retrieval QA (#5020) 
* add langchain

* add langchain

* Add files via upload

* add langchain

* fix style

* fix style: remove extra space

* add pytest; modified retriever

* add pytest; modified retriever

* add tests to build_on_pr.yml

* fix build_on_pr.yml

* fix build on pr; fix environ vars

* seperate unit tests for colossalqa from build from pr

* fix container setting; fix environ vars

* commented dev code

* add incremental update

* remove stale code

* fix style

* change to sha3 224

* fix retriever; fix style; add unit test for document loader

* fix ci workflow config

* fix ci workflow config

* add set cuda visible device script in ci

* fix doc string

* fix style; update readme; refactored

* add force log info

* change build on pr, ignore colossalqa

* fix docstring, captitalize all initial letters

* fix indexing; fix text-splitter

* remove debug code, update reference

* reset previous commit

* update LICENSE update README add key-value mode, fix bugs

* add files back

* revert force push

* remove junk file

* add test files

* fix retriever bug, add intent classification

* change conversation chain design

* rewrite prompt and conversation chain

* add ui v1

* ui v1

* fix atavar

* add header

* Refactor the RAG Code and support Pangu

* Refactor the ColossalQA chain to Object-Oriented Programming and the UI demo.

* resolved conversation. tested scripts under examples. web demo still buggy

* fix ci tests

* Some modifications to add ChatGPT api

* modify llm.py and remove unnecessary files

* Delete applications/ColossalQA/examples/ui/test_frontend_input.json

* Remove OpenAI api key

* add colossalqa

* move files

* move files

* move files

* move files

* fix style

* Add Readme and fix some bugs.

* Add something to readme and modify some code

* modify a directory name for clarity

* remove redundant directory

* Correct a type in  llm.py

* fix AI prefix

* fix test_memory.py

* fix conversation

* fix some erros and typos

* Fix a missing import in RAG_ChatBot.py

* add colossalcloud LLM wrapper, correct issues in code review

---------

Co-authored-by: YeAnbang <anbangy2@outlook.com>
Co-authored-by: Orion-Zheng <zheng_zian@u.nus.edu>
Co-authored-by: Zian(Andy) Zheng <62330719+Orion-Zheng@users.noreply.github.com>
Co-authored-by: Orion-Zheng <zhengzian@u.nus.edu>
 2023-11-23 10:33:48 +08:00
Orion-Zheng 43ad0d9ef0 fix wrong EOS token in ColossalChat 2023-11-14 10:49:49 +08:00
Yuanchen 239cd92eff
Support mtbench (#5025) 
Co-authored-by: Xu Yuanchen <yuanchen.xu00@gmail.com>
 2023-11-09 13:41:50 +08:00
Yuanchen abe071b663
fix ColossalEval (#4992) 
Co-authored-by: Xu Yuanchen <yuanchen.xu00@gmail.com>
 2023-10-31 10:30:03 +08:00
github-actions[bot] a41cf88e9b
[format] applied code formatting on changed files in pull request 4908 (#4918) 
Co-authored-by: github-actions <github-actions@github.com>
 2023-10-17 10:48:24 +08:00
Zian(Andy) Zheng 7768afbad0 Update flash_attention_patch.py 
To be compatible with the new change in the Transformers library, where a new argument 'padding_mask' was added to forward function of attention layer.
https://github.com/huggingface/transformers/pull/25598
 2023-10-16 14:00:45 +08:00
Camille Zhong 652adc2215 Update README.md 2023-10-10 23:19:34 +08:00
Camille Zhong afe10a85fd Update README.md 2023-10-10 23:19:34 +08:00
Camille Zhong 3043d5d676 Update modelscope link in README.md 
add modelscope link
 2023-10-10 23:19:34 +08:00