github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
ColossalAI/applications/Chat/coati/dataset
History
yingliu-hpc 1467e3b41b
[coati] add chatglm model (#4539) 
* update configuration of chatglm and add support in coati

* add unit test & update chatglm default config & fix bos index issue

* remove chatglm due to oom

* add dataset pkg in requirement-text

* fix parameter issue in test_models

* add ref in tokenize & rm unnessary parts

* separate source & target tokenization in chatglm

* add unit test to chatglm

* fix test dataset issue

* update truncation of chatglm

* fix Colossalai version

* fix colossal ai version in test
 		2023-08-29 17:58:51 +08:00
..
__init__.py [chat] fix bugs and add unit tests (#4213) 2023-08-02 10:17:36 +08:00
conversation.py support session-based training (#4313) 2023-07-28 11:29:55 +08:00
prompt_dataset.py [chat] fix bugs and add unit tests (#4213) 2023-08-02 10:17:36 +08:00
reward_dataset.py [chat] fix bugs and add unit tests (#4213) 2023-08-02 10:17:36 +08:00
sft_dataset.py [coati] add chatglm model (#4539) 2023-08-29 17:58:51 +08:00
utils.py [Coati] first commit (#3283) 2023-03-28 20:25:36 +08:00