19 Commits (3e05c07bb8921f2a8f9736b6f6673d4e9f1697d0)

Author	SHA1	Message	Date
Hongxin Liu	079bf3cb26	[misc] update pre-commit and run all files (#4752) ... * [misc] update pre-commit * [misc] run pre-commit * [misc] remove useless configuration files * [misc] ignore cuda for clang-format	1 year ago
digger yu	e4fc57c3de	Optimized some syntax errors in the documentation and code under applications/ (#4127) ... Co-authored-by: flybird11111 <1829166702@qq.com>	1 year ago
Michelle	285fe7ba71	[chat] update config and prompt (#4139) ... * update config and prompt * update config --------- Co-authored-by: Qianran Ma <qianranm@luchentech.com>	1 year ago
Wenhao Chen	6d41c3f2aa	[doc] update Coati README (#4405) ... * style: apply formatter * fix: add outdated warnings * docs: add dataset format and polish * docs: polish README * fix: fix json format * fix: fix typos * revert: revert 7b example	1 year ago
Michelle	e89b127d8e	[chat]: fix chat evaluation possible bug (#4064) ... * fix chat eval * fix utils * fix utils * add comment --------- Co-authored-by: Qianran Ma <qianranm@luchentech.com>	1 year ago
digger yu	727c4598a9	[nfc] fix dim not defined and fix typo (#3991)	1 year ago
Yuanchen	2925f47399	[evaluate] support gpt evaluation with reference (#3972) ... Co-authored-by: Yuanchen Xu <yuanchen.xu00@gmail.com>	1 year ago
Yuanchen	21c4c0b1a0	support UniEval and add CHRF metric (#3924) ... Co-authored-by: Yuanchen Xu <yuanchen.xu00@gmail.com>	1 year ago
Yuanchen	57a6d7685c	support evaluation for english (#3880) ... Co-authored-by: Yuanchen Xu <yuanchen.xu00@gmail.com>	1 year ago
Yuanchen	2506e275b8	[evaluation] improvement on evaluation (#3862) ... * fix a bug when the config file contains one category but the answer file doesn't contains that category * fix Chinese prompt file * support gpt-3.5-turbo and gpt-4 evaluation * polish and update README * resolve pr comments --------- Co-authored-by: Yuanchen Xu <yuanchen.xu00@gmail.com>	2 years ago
digger yu	e2d81eba0d	[nfc] fix typo colossalai/ applications/ (#3831) ... * fix typo colossalai/autochunk auto_parallel amp * fix typo colossalai/auto_parallel nn utils etc. * fix typo colossalai/auto_parallel autochunk fx/passes etc. * fix typo docs/ * change placememt_policy to placement_policy in docs/ and examples/ * fix typo colossalai/ applications/	2 years ago
Yuanchen	34966378e8	[evaluation] add automatic evaluation pipeline (#3821) ... * add functions for gpt evaluation * add automatic eval Update eval.py * using jload and modify the type of answers1 and answers2 * Update eval.py Update eval.py * Update evaluator.py * support gpt evaluation * update readme.md update README.md update READNE.md modify readme.md * add Chinese example for config, battle prompt and evaluation prompt file * remove GPT-4 config * remove sample folder --------- Co-authored-by: Yuanchen Xu <yuanchen.xu00@gmail.com> Co-authored-by: Camille Zhong <44392324+Camille7777@users.noreply.github.com>	2 years ago
digger-yu	8ba7858753	Update generate_gpt35_answers.py ... fix spelling error with generate_gpt35_answers.py	2 years ago
digger-yu	bfbf650588	fix spelling error ... fix spelling error with evaluate.py	2 years ago
Tong Li	c1a355940e	update readme	2 years ago
Tong Li	ed3eaa6922	update documentation	2 years ago
Tong Li	c419117329	update questions and readme	2 years ago
Tong Li	aa77ddae33	remove unnecessary step and update readme	2 years ago
Yuanchen	c4709d34cf	Chat evaluate (#3608) ... Co-authored-by: Yuanchen Xu <yuanchen.xu00@gmail.com>	2 years ago