ColossalAI/colossalai/utils
アマデウス 9ee197d0e9 moved env variables to global variables; (#215)
added branch context;
added vocab parallel layers;
moved split_batch from load_batch to tensor parallel embedding layers;
updated gpt model;
updated unit test cases;
fixed few collective communicator bugs
2022-02-15 11:31:13 +08:00
..
data_sampler fixed utils docstring and add example to readme (#200) 2022-02-03 11:37:17 +08:00
gradient_accumulation Fixed docstring in colossalai (#171) 2022-01-21 10:44:30 +08:00
multi_tensor_apply Fixed docstring in colossalai (#171) 2022-01-21 10:44:30 +08:00
__init__.py moved env variables to global variables; (#215) 2022-02-15 11:31:13 +08:00
activation_checkpoint.py Fixed docstring in colossalai (#171) 2022-01-21 10:44:30 +08:00
checkpointing.py Fixed docstring in colossalai (#171) 2022-01-21 10:44:30 +08:00
common.py moved env variables to global variables; (#215) 2022-02-15 11:31:13 +08:00
cuda.py Fixed docstring in colossalai (#171) 2022-01-21 10:44:30 +08:00
memory.py Fixed docstring in colossalai (#171) 2022-01-21 10:44:30 +08:00
timer.py Fixed docstring in colossalai (#171) 2022-01-21 10:44:30 +08:00