Zhongkai Zhao 361cf63cb0 [Refactor] refactor policy search and quant type controlling in inference (#5035) ... * [Refactor] refactor policy search and quant type controling in inference		2023-11-14 17:26:59 +08:00
..
modeling	[Refactor] remove useless inference code (#5022)	2023-11-10 14:47:06 +08:00
polices	[Refactor] refactor policy search and quant type controlling in inference (#5035)	2023-11-14 17:26:59 +08:00
__init__.py	[Pipeline Inference] Merge pp with tp (#4993)	2023-11-01 12:46:21 +08:00
engine.py	[Refactor] remove useless inference code (#5022)	2023-11-10 14:47:06 +08:00
microbatch_manager.py	[Refactor] remove useless inference code (#5022)	2023-11-10 14:47:06 +08:00