ColossalAI/colossalai/communication
アマデウス 9ee197d0e9 moved env variables to global variables; (#215)
added branch context;
added vocab parallel layers;
moved split_batch from load_batch to tensor parallel embedding layers;
updated gpt model;
updated unit test cases;
fixed few collective communicator bugs
2022-02-15 11:31:13 +08:00
..
__init__.py add scatter/gather optim for pipeline (#123) 2022-01-07 13:22:22 +08:00
collective.py moved env variables to global variables; (#215) 2022-02-15 11:31:13 +08:00
p2p.py add scatter/gather optim for pipeline (#123) 2022-01-07 13:22:22 +08:00
ring.py update examples and sphnix docs for the new api (#63) 2021-12-13 22:07:01 +08:00
utils.py Fixed docstring in colossalai (#171) 2022-01-21 10:44:30 +08:00