ColossalAI/colossalai/fx/passes
Ziyue Jiang 59e343328d
[Pipeline Middleware ] Fix deadlock when num_microbatch=num_stage (#2156)
* add splitter

* polish code

* remove comment

* fix async nan by moving to cpu first

Co-authored-by: Ziyue Jiang <ziyue.jiang@gmail.com>
2022-12-23 11:38:43 +08:00
..
algorithms
experimental
__init__.py
adding_split_node_pass.py [Pipeline Middleware ] Fix deadlock when num_microbatch=num_stage (#2156) 2022-12-23 11:38:43 +08:00
concrete_info_prop.py
meta_info_prop.py [SC] add GPT example for auto checkpoint (#1889) 2022-11-11 23:17:25 +08:00
passes_for_gpt2_test.py
shard_1d_pass.py
split_module.py [Pipeline] Add Topo Class (#2059) 2022-12-02 18:13:20 +08:00
utils.py [Pipeline] Add Topo Class (#2059) 2022-12-02 18:13:20 +08:00