ColossalAI/colossalai/nn/layer
アマデウス 9ee197d0e9 moved env variables to global variables; (#215)
added branch context;
added vocab parallel layers;
moved split_batch from load_batch to tensor parallel embedding layers;
updated gpt model;
updated unit test cases;
fixed few collective communicator bugs
2022-02-15 11:31:13 +08:00
..
colossalai_layer moved env variables to global variables; (#215) 2022-02-15 11:31:13 +08:00
moe Fixed docstring in colossalai (#171) 2022-01-21 10:44:30 +08:00
parallel_1d moved env variables to global variables; (#215) 2022-02-15 11:31:13 +08:00
parallel_2d moved env variables to global variables; (#215) 2022-02-15 11:31:13 +08:00
parallel_2p5d moved env variables to global variables; (#215) 2022-02-15 11:31:13 +08:00
parallel_3d moved env variables to global variables; (#215) 2022-02-15 11:31:13 +08:00
parallel_sequence adapted for sequence parallel (#163) 2022-01-20 13:44:51 +08:00
utils moved env variables to global variables; (#215) 2022-02-15 11:31:13 +08:00
vanilla moved env variables to global variables; (#215) 2022-02-15 11:31:13 +08:00
wrapper Fixed docstring in colossalai (#171) 2022-01-21 10:44:30 +08:00
__init__.py Hotfix/Colossalai layers (#92) 2021-12-29 23:32:10 +08:00
base_layer.py Migrated project 2021-10-28 18:21:23 +02:00