Commit Graph

3 Commits (27327a4c907796368df0923a1e66b8a39c2fe3bd)

Author SHA1 Message Date
Yuer867 4a0f8c2c50 fix format parallel_2p5d (#357) 2022-03-11 15:50:28 +08:00
アマデウス 9ee197d0e9 moved env variables to global variables; (#215)
added branch context;
added vocab parallel layers;
moved split_batch from load_batch to tensor parallel embedding layers;
updated gpt model;
updated unit test cases;
fixed few collective communicator bugs
2022-02-15 11:31:13 +08:00
zbian 404ecbdcc6 Migrated project 2021-10-28 18:21:23 +02:00