mirror of https://github.com/hpcaitech/ColossalAI
2731531bc2
* [autoparallel] integrate device mesh initialization into autoparallelize * add megatron solution * update gpt autoparallel examples with latest api * adapt beta value to fit the current computation cost |
||
---|---|---|
.. | ||
__init__.py | ||
alpha_beta_profiler.py | ||
calc_pipeline_strategy.py | ||
device_mesh.py |