1 Commits (17cfa5714083a81a505c097f1c411cd28162d922)

Author	SHA1	Message	Date
Yuanheng Zhao	17cfa57140	[infer] Add Bloom inference policy and replaced methods (#4512) ... * add bloom inference methods and policy * enable pass BatchInferState from model forward * revise bloom infer layers/policies * add engine for inference (draft) * add test for bloom infer * fix bloom infer policy and flow * revise bloom test * fix bloom file path * remove unused codes * fix bloom modeling * fix dir typo * fix trivial * fix policy * clean pr * trivial fix	2023-08-30 17:50:41 +08:00