mirror of https://github.com/hpcaitech/ColossalAI
9ee197d0e9
added branch context; added vocab parallel layers; moved split_batch from load_batch to tensor parallel embedding layers; updated gpt model; updated unit test cases; fixed few collective communicator bugs |
||
---|---|---|
.. | ||
__init__.py | ||
initializer_1d.py | ||
initializer_2d.py | ||
initializer_2p5d.py | ||
initializer_3d.py | ||
initializer_data.py | ||
initializer_model.py | ||
initializer_moe.py | ||
initializer_pipeline.py | ||
initializer_sequence.py | ||
initializer_tensor.py | ||
process_group_initializer.py |