ColossalAI/colossalai/nn/parallel
HELSON 8213f89fd2
[gemini] add fake_release_chunk for keep-gathered chunk in the inference mode (#2671)
2023-02-13 14:35:32 +08:00
..
layers [embedding] rename FreqAwareEmbedding -> CachedEmbedding (#1699) 2022-10-13 22:22:27 +08:00
__init__.py [zero] add zero wrappers (#2523) 2023-01-29 17:52:58 +08:00
data_parallel.py [gemini] add fake_release_chunk for keep-gathered chunk in the inference mode (#2671) 2023-02-13 14:35:32 +08:00
gemini_parallel.py [hotfix] fix lightning error (#2529) 2023-01-31 10:40:39 +08:00
reducer.py [ddp] ColoDDP uses bucket all-reduce (#1177) 2022-06-29 10:34:13 +08:00
utils.py [hotfix] fix lightning error (#2529) 2023-01-31 10:40:39 +08:00
zero_wrapper.py [gemini] update the gpt example (#2527) 2023-01-30 17:58:05 +08:00