mirror of https://github.com/hpcaitech/ColossalAI
aibig-modeldata-parallelismdeep-learningdistributed-computingfoundation-modelsheterogeneous-traininghpcinferencelarge-scalemodel-parallelismpipeline-parallelism
You can not select more than 25 topics
Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
Frank Lee
7cfed5f076
|
10 months ago | |
---|---|---|
.. | ||
cpu_adam | 10 months ago | |
csrc | 10 months ago | |
flash_attention | 10 months ago | |
layernorm | 10 months ago | |
moe | 10 months ago | |
optimizer | 10 months ago | |
softmax | 10 months ago | |
__init__.py | 10 months ago | |
base_extension.py | 10 months ago | |
cpp_extension.py | 10 months ago | |
cuda_extension.py | 10 months ago | |
triton_extension.py | 10 months ago | |
utils.py | 10 months ago |