ColossalAI

Commit Graph

Author	SHA1	Message	Date
アマデウス	9ee197d0e9	moved env variables to global variables; (#215 ) added branch context; added vocab parallel layers; moved split_batch from load_batch to tensor parallel embedding layers; updated gpt model; updated unit test cases; fixed few collective communicator bugs	2022-02-15 11:31:13 +08:00
アマデウス	0fedef4f3c	Layer integration (#83 ) * integrated parallel layers for ease of building models * integrated 2.5d layers * cleaned codes and unit tests * added log metric by step hook; updated imagenet benchmark; fixed some bugs * reworked initialization; cleaned codes Co-authored-by: BoxiangW <45734921+BoxiangW@users.noreply.github.com>	2021-12-27 15:04:32 +08:00
Frank Lee	cd9c28e055	added CI for unit testing (#69 )	2021-12-16 10:32:08 +08:00

Author

SHA1

Message

Date

アマデウス

9ee197d0e9

moved env variables to global variables; (#215 )

added branch context;
added vocab parallel layers;
moved split_batch from load_batch to tensor parallel embedding layers;
updated gpt model;
updated unit test cases;
fixed few collective communicator bugs

2022-02-15 11:31:13 +08:00

アマデウス

0fedef4f3c

Layer integration (#83 )

* integrated parallel layers for ease of building models

* integrated 2.5d layers

* cleaned codes and unit tests

* added log metric by step hook; updated imagenet benchmark; fixed some bugs

* reworked initialization; cleaned codes

Co-authored-by: BoxiangW <45734921+BoxiangW@users.noreply.github.com>

2021-12-27 15:04:32 +08:00

Frank Lee

cd9c28e055

added CI for unit testing (#69 )

2021-12-16 10:32:08 +08:00

3 Commits (c638bec02887dd6f19f450174d6d9b04f4f3dd05)