github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
2,947 Commits
40 Branches
49 Tags
234 MiB
Commit Graph

1 Commits (fab9b931d9e24c6e8ada8025cf8cf12719c3d2af)

Author SHA1 Message Date
yuehuayingxueluo fab9b931d9 [Inference]Add BatchInferState, Sequence and InferConfig (#5149) 
* add infer_struct and infer_config

* update codes

* change InferConfig

* Add hf_model_config to the engine

* rm _get_hf_model_config

* update codes

* made adjustments according to the feedback from the reviewer.

* update codes

* add ci test for config and struct
 2024-01-11 13:39:29 +00:00