ColossalAI/tests
Jianghai ce7ade3882
[inference] chatglm2 infer demo (#4724)
* add chatglm2

* add

* gather needed kernels

* fix some bugs

* finish context forward

* finish context stage

* fix

* add

* pause

* add

* fix bugs

* finish chatglm

* fix bug

* change some logic

* fix bugs

* change some logics

* add

* add

* add

* fix

* fix tests

* fix
2023-09-22 11:12:50 +08:00
..
components_to_test [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
kit [inference] chatglm2 infer demo (#4724) 2023-09-22 11:12:50 +08:00
test_analyzer [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
test_auto_parallel [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
test_autochunk [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
test_booster [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
test_checkpoint_io [shardformer] fix master param sync for hybrid plugin/rewrite unwrapping logic (#4758) 2023-09-20 18:29:37 +08:00
test_cluster [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
test_config [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
test_device [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
test_fx [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
test_gptq [feature] add gptq for inference (#4754) 2023-09-22 11:02:50 +08:00
test_infer [inference] chatglm2 infer demo (#4724) 2023-09-22 11:12:50 +08:00
test_infer_ops [inference] chatglm2 infer demo (#4724) 2023-09-22 11:12:50 +08:00
test_lazy [lazy] support torch 2.0 (#4763) 2023-09-21 16:30:23 +08:00
test_legacy [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
test_moe [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
test_optimizer [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
test_pipeline [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
test_shardformer [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
test_tensor [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
test_utils [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
test_zero [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
__init__.py [zero] Update sharded model v2 using sharded param v2 (#323) 2022-03-11 15:50:28 +08:00