You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Runyu Lu cefaeb5fdd [feat] cuda graph support and refactor non-functional api		9 months ago
..
layers	[Inference]Fused the gate and up proj in mlp，and optimized the autograd process. (#5365)	10 months ago
models	[feat] cuda graph support and refactor non-functional api	9 months ago
policy	Optimized the execution interval time between cuda kernels caused by view and memcopy (#5390)	9 months ago
__init__.py	[doc] updated inference readme (#5343)	10 months ago