7 Commits (ba36f4dadd34d71ce462da609d07e9c83cb5bd33)

Author	SHA1	Message	Date
saber	ba36f4dadd	doc: Add doctest examples for calculate_per_gpu_layers and auto_configure_device_map	2023-03-28 22:27:04 +08:00
saber	8c16099064	feat: Implement GPU layer allocation based on memory ratio	2023-03-28 21:57:49 +08:00
saber	c313af0639	Add support for manual device_map; auto-config if None	2023-03-27 22:20:23 +08:00
saber	c31d9c0984	Move import statement into function to avoid dependency	2023-03-27 22:11:57 +08:00
saber	6a5267aef7	bugfix: linux多卡部署时weight,input不在同一device上,导致RuntimeError	2023-03-27 20:51:05 +08:00
saber	8101d75ab8	fix typo	2023-03-26 15:29:15 +08:00
saber	8826b947c3	多GPU支持, 模型文件夹没有index.json会自动保存模型到multi_gpu_model_cache_dir以支持多GPU	2023-03-26 15:13:44 +08:00