ColossalAI/colossalai/nn/parallel
ver217 1f894e033f
[gemini] zero supports gemini (#1093)
* add placement policy

* add gemini mgr

* update mem stats collector

* update zero

* update zero optim

* fix bugs

* zero optim monitor os

* polish unit test

* polish unit test

* add assert
2022-06-10 14:48:28 +08:00
..
layers [refactory] add nn.parallel module (#1068) 2022-06-06 15:34:41 +08:00
__init__.py [refactory] add nn.parallel module (#1068) 2022-06-06 15:34:41 +08:00
data_parallel.py [gemini] zero supports gemini (#1093) 2022-06-10 14:48:28 +08:00