ColossalAI/colossalai
YuliangLiu0306 e34e850a4c
[autoparallel]add essential CommActions for broadcast oprands (#1793)
2022-11-04 18:36:42 +08:00
..
amp
auto_parallel [autoparallel]add essential CommActions for broadcast oprands (#1793) 2022-11-04 18:36:42 +08:00
builder
cli
communication
context
device
engine
fx [autoparallel]add essential CommActions for broadcast oprands (#1793) 2022-11-04 18:36:42 +08:00
gemini [hotfix] fix zero's incompatibility with checkpoint in torch-1.12 (#1786) 2022-11-02 16:11:34 +08:00
kernel [feat] add flash attention (#1762) 2022-10-26 16:15:52 +08:00
logging
nn [hotfix] fix zero's incompatibility with checkpoint in torch-1.12 (#1786) 2022-11-02 16:11:34 +08:00
pipeline
registry
tensor [hotfix] fix zero's incompatibility with checkpoint in torch-1.12 (#1786) 2022-11-02 16:11:34 +08:00
testing
trainer
utils
zero [hotfix] fix zero's incompatibility with checkpoint in torch-1.12 (#1786) 2022-11-02 16:11:34 +08:00
__init__.py
constants.py
core.py
global_variables.py
initialize.py