ColossalAI/colossalai/nn/parallel
HELSON e37f3db40c
[gemini] add arguments (#2046)
* [zero] fix testing parameters

* [gemini] add arguments

* add docstrings
2022-11-30 16:40:13 +08:00
..
layers [embedding] rename FreqAwareEmbedding -> CachedEmbedding (#1699) 2022-10-13 22:22:27 +08:00
__init__.py [Gemini] make gemini usage simple (#1821) 2022-11-08 15:53:13 +08:00
data_parallel.py [hotfix] add bert test for gemini fwd bwd (#2035) 2022-11-29 11:19:52 +08:00
gemini_parallel.py [gemini] add arguments (#2046) 2022-11-30 16:40:13 +08:00
reducer.py [ddp] ColoDDP uses bucket all-reduce (#1177) 2022-06-29 10:34:13 +08:00
utils.py [feature] A new ZeRO implementation (#1644) 2022-10-09 09:18:51 +08:00