mirror of https://github.com/hpcaitech/ColossalAI
aibig-modeldata-parallelismdeep-learningdistributed-computingfoundation-modelsheterogeneous-traininghpcinferencelarge-scalemodel-parallelismpipeline-parallelism
You can not select more than 25 topics
Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
Wang Binluo
dcd41d0973
|
1 month ago | |
---|---|---|
.. | ||
test_hybrid_parallel_grad_clip_norm | 5 months ago | |
test_layer | 1 month ago | |
test_model | 2 months ago | |
__init__.py | 1 year ago | |
test_flash_attention.py | 3 months ago | |
test_shard_utils.py | 1 year ago | |
test_with_torch_ddp.py | 7 months ago |