ColossalAI

Commit Graph

Author	SHA1	Message	Date
Runyu Lu	3c7cda0c9a	[Inference]Lazy Init Support (#5785 ) * lazy init support * lazy init llama support * :lazy init support for baichuan * aligh rpc * add note for baichuan --------- Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>	2024-06-27 18:02:15 +08:00
Runyu Lu	c0948aff97	[Inference]refactor baichuan (#5791 ) * refactor baichuan * remove unused code and add TODO for lazyinit	2024-06-11 10:52:01 +08:00
yuehuayingxueluo	5f00002e43	[Inference] Adapt Baichuan2-13B TP (#5659 ) * adapt to baichuan2 13B * add baichuan2 13B TP * update baichuan tp logic * rm unused code * Fix TP logic * fix alibi slopes tp logic * rm nn.Module * Polished the code. * change BAICHUAN_MODEL_NAME_OR_PATH * Modified the logic for loading Baichuan weights. * fix typos	2024-04-30 15:47:07 +08:00

Author

SHA1

Message

Date

Runyu Lu

3c7cda0c9a

[Inference]Lazy Init Support (#5785 )

* lazy init support

* lazy init llama support

* :lazy init support for baichuan

* aligh rpc

* add note for baichuan

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

2024-06-27 18:02:15 +08:00

Runyu Lu

c0948aff97

[Inference]refactor baichuan (#5791 )

* refactor baichuan

* remove unused code and add TODO for lazyinit

2024-06-11 10:52:01 +08:00

yuehuayingxueluo

5f00002e43

[Inference] Adapt Baichuan2-13B TP (#5659 )

* adapt to baichuan2 13B

* add baichuan2 13B TP

* update baichuan tp logic

* rm unused code

* Fix TP logic

* fix alibi slopes tp logic

* rm nn.Module

* Polished the code.

* change BAICHUAN_MODEL_NAME_OR_PATH

* Modified the logic for loading Baichuan weights.

* fix typos

2024-04-30 15:47:07 +08:00

3 Commits (7b38964e3a977aa92d40200059d9076b622bf9b7)