3 Commits (89a9a600bc4802c912b0ed48d48f70bbcdd8142b)

Author	SHA1	Message	Date
Runyu Lu	3c7cda0c9a	[Inference]Lazy Init Support (#5785) ... * lazy init support * lazy init llama support * :lazy init support for baichuan * aligh rpc * add note for baichuan --------- Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>	5 months ago
Runyu Lu	c0948aff97	[Inference]refactor baichuan (#5791) ... * refactor baichuan * remove unused code and add TODO for lazyinit	6 months ago
yuehuayingxueluo	5f00002e43	[Inference] Adapt Baichuan2-13B TP (#5659) ... * adapt to baichuan2 13B * add baichuan2 13B TP * update baichuan tp logic * rm unused code * Fix TP logic * fix alibi slopes tp logic * rm nn.Module * Polished the code. * change BAICHUAN_MODEL_NAME_OR_PATH * Modified the logic for loading Baichuan weights. * fix typos	7 months ago