ColossalAI/colossalai/nn/parallel
Jiarui Fang 9214d1fe28
[Gemini] chunk init using runtime visited param order (#2115)
2022-12-12 18:06:16 +08:00
..
layers [embedding] rename FreqAwareEmbedding -> CachedEmbedding (#1699) 2022-10-13 22:22:27 +08:00
__init__.py [Gemini] make gemini usage simple (#1821) 2022-11-08 15:53:13 +08:00
data_parallel.py [Gemini] chunk init using runtime visited param order (#2115) 2022-12-12 18:06:16 +08:00
gemini_parallel.py [Gemini] chunk init using runtime visited param order (#2115) 2022-12-12 18:06:16 +08:00
reducer.py [ddp] ColoDDP uses bucket all-reduce (#1177) 2022-06-29 10:34:13 +08:00
utils.py [NFC] polish comments for Chunk class (#2116) 2022-12-12 15:39:31 +08:00