Jiarui Fang 96134e7be3 [hotfix] add bert test for gemini fwd bwd (#2035)		2022-11-29 11:19:52 +08:00
..
layers	[embedding] rename FreqAwareEmbedding -> CachedEmbedding (#1699)	2022-10-13 22:22:27 +08:00
__init__.py	[Gemini] make gemini usage simple (#1821)	2022-11-08 15:53:13 +08:00
data_parallel.py	[hotfix] add bert test for gemini fwd bwd (#2035)	2022-11-29 11:19:52 +08:00
gemini_parallel.py	[Gemini] add GeminiAdamOptimizer (#1960)	2022-11-16 14:44:28 +08:00
reducer.py	[ddp] ColoDDP uses bucket all-reduce (#1177)	2022-06-29 10:34:13 +08:00
utils.py	[feature] A new ZeRO implementation (#1644)	2022-10-09 09:18:51 +08:00