ColossalAI/colossalai/nn/layer/colossalai_layer
アマデウス 9ee197d0e9 moved env variables to global variables; (#215)
added branch context;
added vocab parallel layers;
moved split_batch from load_batch to tensor parallel embedding layers;
updated gpt model;
updated unit test cases;
fixed few collective communicator bugs
2022-02-15 11:31:13 +08:00
..
__init__.py moved env variables to global variables; (#215) 2022-02-15 11:31:13 +08:00
_utils.py moved env variables to global variables; (#215) 2022-02-15 11:31:13 +08:00
dropout.py moved env variables to global variables; (#215) 2022-02-15 11:31:13 +08:00
embedding.py moved env variables to global variables; (#215) 2022-02-15 11:31:13 +08:00
linear.py moved env variables to global variables; (#215) 2022-02-15 11:31:13 +08:00
normalization.py moved env variables to global variables; (#215) 2022-02-15 11:31:13 +08:00