mirror of https://github.com/hpcaitech/ColossalAI
![]() added branch context; added vocab parallel layers; moved split_batch from load_batch to tensor parallel embedding layers; updated gpt model; updated unit test cases; fixed few collective communicator bugs |
||
---|---|---|
.. | ||
csrc | ||
__init__.py | ||
layer_norm.py | ||
multihead_attention.py | ||
scaled_softmax.py |