3 Commits (5f8c0a0ac3b52a71b664c3e36dd1a8cef40f428d)

Author	SHA1	Message	Date
Yuanheng Zhao	283c407a19	[Inference] Fix Inference Generation Config and Sampling (#5710) ... * refactor and add * config default values * fix gen config passing * fix rpc generation config	6 months ago
Runyu Lu	74c47921fa	[Fix] Llama3 Load/Omit CheckpointIO Temporarily (#5717) ... * Fix Llama3 Load error * Omit Checkpoint IO Temporarily	7 months ago
Runyu Lu	18d67d0e8e	[Feat]Inference RPC Server Support (#5705) ... * rpc support source * kv cache logical/physical disaggregation * sampler refactor * colossalai launch built in * Unitest * Rpyc support --------- Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>	7 months ago