ColossalAI

Commit Graph

Author	SHA1	Message	Date
アマデウス	9ee197d0e9	moved env variables to global variables; (#215 ) added branch context; added vocab parallel layers; moved split_batch from load_batch to tensor parallel embedding layers; updated gpt model; updated unit test cases; fixed few collective communicator bugs	2022-02-15 11:31:13 +08:00
HELSON	0f8c7f9804	Fixed docstring in colossalai (#171 )	2022-01-21 10:44:30 +08:00
アマデウス	01a80cd86d	Hotfix/Colossalai layers (#92 ) * optimized 1d layer apis; reorganized nn.layer modules; fixed tests * fixed 2.5d runtime issue * reworked split batch, now called in trainer.schedule.load_batch Co-authored-by: BoxiangW <45734921+BoxiangW@users.noreply.github.com>	2021-12-29 23:32:10 +08:00

Author

SHA1

Message

Date

アマデウス

9ee197d0e9

moved env variables to global variables; (#215 )

added branch context;
added vocab parallel layers;
moved split_batch from load_batch to tensor parallel embedding layers;
updated gpt model;
updated unit test cases;
fixed few collective communicator bugs

2022-02-15 11:31:13 +08:00

HELSON

0f8c7f9804

Fixed docstring in colossalai (#171 )

2022-01-21 10:44:30 +08:00

アマデウス

01a80cd86d

Hotfix/Colossalai layers (#92 )

* optimized 1d layer apis; reorganized nn.layer modules; fixed tests

* fixed 2.5d runtime issue

* reworked split batch, now called in trainer.schedule.load_batch

Co-authored-by: BoxiangW <45734921+BoxiangW@users.noreply.github.com>

2021-12-29 23:32:10 +08:00

3 Commits (82023779bb4ca1c70be79c81544c5ca9398106df)