You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Yuanheng Zhao 573f270537 [Infer] Serving example w/ ray-serve (multiple GPU case) (#4841) ... * fix imports * add ray-serve with Colossal-Infer tp * trivial: send requests script * add README * fix worker port * fix readme * use app builder and autoscaling * trivial: input args * clean code; revise readme * testci (skip example test) * use auto model/tokenizer * revert imports fix (fixed in other PRs)		1 year ago
..
ray_serve	[Infer] Serving example w/ ray-serve (multiple GPU case) (#4841)	1 year ago
torch_serve	[Infer] Colossal-Inference serving example w/ TorchServe (single GPU case) (#4771)	1 year ago
test_ci.sh	[Infer] Colossal-Inference serving example w/ TorchServe (single GPU case) (#4771)	1 year ago