Commit Graph

2 Commits (955463e542e2b986da3280be7daad7ebb760a7ea)

Author SHA1 Message Date
Liang Bowen ec5086c49c Refactored docstring to google style 2022-03-29 17:17:47 +08:00
アマデウス 9ee197d0e9 moved env variables to global variables; (#215)
added branch context;
added vocab parallel layers;
moved split_batch from load_batch to tensor parallel embedding layers;
updated gpt model;
updated unit test cases;
fixed few collective communicator bugs
2022-02-15 11:31:13 +08:00