You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
ColossalAI/colossalai/nn/parallel
Geng Zhang 9f3eed66eb
[FAW] reorganize the inheritance struct of FreqCacheEmbedding (#1448)
2 years ago
..
layers [FAW] reorganize the inheritance struct of FreqCacheEmbedding (#1448) 2 years ago
__init__.py
data_parallel.py [zero] ZeroDDP supports controlling outputs' dtype (#1399) 2 years ago
reducer.py [ddp] ColoDDP uses bucket all-reduce (#1177) 2 years ago