ColossalAI/colossalai/fx/passes
Ziyue Jiang 400f63012e
[pipeline] Add Simplified Alpa DP Partition (#2507)
* add alpa dp split

* add alpa dp split

* use fwd+bwd instead of fwd only

---------

Co-authored-by: Ziyue Jiang <ziyue.jiang@gmail.com>
2023-03-07 10:34:31 +08:00
..
experimental [autoparallel] refactor the runtime apply pass and add docstring to passes (#1757) 2022-10-25 14:32:22 +08:00
__init__.py [fx] metainfo_trace as an API. (#1873) 2022-11-10 20:58:37 +08:00
adding_split_node_pass.py [pipeline] Add Simplified Alpa DP Partition (#2507) 2023-03-07 10:34:31 +08:00
concrete_info_prop.py [fx] refactor memory utils and extend shard utils. (#1754) 2022-10-26 14:24:41 +08:00
meta_info_prop.py [pipeline] Add Simplified Alpa DP Partition (#2507) 2023-03-07 10:34:31 +08:00
passes_for_gpt2_test.py [hotfix] fix some bugs during gpt2 testing (#1379) 2022-07-28 17:21:07 +08:00
shard_1d_pass.py [Doc] add more doc for ColoTensor. (#1458) 2022-08-16 10:38:41 +08:00
split_module.py [Pipeline] Add Topo Class (#2059) 2022-12-02 18:13:20 +08:00
utils.py [Pipeline] Add Topo Class (#2059) 2022-12-02 18:13:20 +08:00