ColossalAI/colossalai/device
YuliangLiu0306 2731531bc2
[autoparallel] integrate device mesh initialization into autoparallelize (#2393)
* [autoparallel] integrate device mesh initialization into autoparallelize

* add megatron solution

* update gpt autoparallel examples with latest api

* adapt beta value to fit the current computation cost
2023-01-11 14:03:49 +08:00
..
__init__.py [device] alpha beta profiler (#2311) 2023-01-05 16:39:55 +08:00
alpha_beta_profiler.py [autoparallel] integrate device mesh initialization into autoparallelize (#2393) 2023-01-11 14:03:49 +08:00
calc_pipeline_strategy.py [autoparallel] Add alpha beta (#1973) 2022-11-17 16:01:14 +08:00
device_mesh.py [autoparallel] integrate device mesh initialization into autoparallelize (#2393) 2023-01-11 14:03:49 +08:00