ColossalAI/colossalai/device
Genghan Zhang d655eea515
[autoparallel] mix gather (#1977)
* Add mix-gather

* Add comments

* Add comments

* Polish comments

* Change the global rank assumption

* Add tests

* Add two-step tests

* Fix 10 and 01

* Skip test becasue the number of GPUs
2022-11-23 21:49:17 +08:00
..
__init__.py [autoparallel] Add alpha beta (#1973) 2022-11-17 16:01:14 +08:00
calc_pipeline_strategy.py [autoparallel] Add alpha beta (#1973) 2022-11-17 16:01:14 +08:00
device_mesh.py [autoparallel] mix gather (#1977) 2022-11-23 21:49:17 +08:00
profile_alpha_beta.py [autoparallel] Add alpha beta (#1973) 2022-11-17 16:01:14 +08:00