ColossalAI/applications/ColossalEval/colossal_eval/dataset
Yuanchen cefdc32615
[ColossalEval] Support GSM, Data Leakage Evaluation and Tensor Parallel (#5169)
* Support GSM, Data Leakage Evaluation and Tensor Parallel

* remove redundant code and update inference.py in examples/gpt_evaluation

---------

Co-authored-by: Xu Yuanchen <yuanchen.xu00@gmail.com>
2023-12-12 14:47:35 +08:00
..
__init__.py [ColossalEval] Support GSM, Data Leakage Evaluation and Tensor Parallel (#5169) 2023-12-12 14:47:35 +08:00
agieval.py [ColossalEval] Support GSM, Data Leakage Evaluation and Tensor Parallel (#5169) 2023-12-12 14:47:35 +08:00
base.py [ColossalEval] Support GSM, Data Leakage Evaluation and Tensor Parallel (#5169) 2023-12-12 14:47:35 +08:00
ceval.py [ColossalEval] Support GSM, Data Leakage Evaluation and Tensor Parallel (#5169) 2023-12-12 14:47:35 +08:00
cmmlu.py [ColossalEval] Support GSM, Data Leakage Evaluation and Tensor Parallel (#5169) 2023-12-12 14:47:35 +08:00
colossalai.py [feature] ColossalEval: Evaluation Pipeline for LLMs (#4786) 2023-09-24 23:14:11 +08:00
cvalues.py [FEATURE] Add Safety Eval Datasets to ColossalEval (#5095) 2023-11-28 11:15:04 +08:00
gaokaobench.py [ColossalEval] Support GSM, Data Leakage Evaluation and Tensor Parallel (#5169) 2023-12-12 14:47:35 +08:00
gsm.py [ColossalEval] Support GSM, Data Leakage Evaluation and Tensor Parallel (#5169) 2023-12-12 14:47:35 +08:00
longbench.py [feature] ColossalEval: Evaluation Pipeline for LLMs (#4786) 2023-09-24 23:14:11 +08:00
mmlu.py [ColossalEval] Support GSM, Data Leakage Evaluation and Tensor Parallel (#5169) 2023-12-12 14:47:35 +08:00
mtbench.py Support mtbench (#5025) 2023-11-09 13:41:50 +08:00
safetybench_en.py [FEATURE] Add Safety Eval Datasets to ColossalEval (#5095) 2023-11-28 11:15:04 +08:00
safetybench_zh.py [FEATURE] Add Safety Eval Datasets to ColossalEval (#5095) 2023-11-28 11:15:04 +08:00