ColossalAI/colossalai/nn/parallel
Jiarui Fang 363fc2861a
[embeddings] more detailed timer (#1692)
2022-10-12 12:01:21 +08:00
..
layers [embeddings] more detailed timer (#1692) 2022-10-12 12:01:21 +08:00
__init__.py [ddp] refactor ColoDDP and ZeroDDP (#1146) 2022-06-21 16:35:23 +08:00
data_parallel.py [feature] A new ZeRO implementation (#1644) 2022-10-09 09:18:51 +08:00
reducer.py [ddp] ColoDDP uses bucket all-reduce (#1177) 2022-06-29 10:34:13 +08:00
utils.py [feature] A new ZeRO implementation (#1644) 2022-10-09 09:18:51 +08:00