ColossalAI/colossalai/pipeline/schedule
LuGY a78daf6180
[shardformer] support interleaved pipeline (#4448)
* support interleaved pipeline

* fix unit test

* remove virtual stage test in stage mgr

* add droped type hint and updated bwd
2023-08-16 19:29:03 +08:00
..
__init__.py
_utils.py [pipeline] rewrite t5 tests & support multi-tensor transmitting in pipeline (#4388) 2023-08-15 23:25:14 +08:00
base.py
interleaved_pp.py [shardformer] support interleaved pipeline (#4448) 2023-08-16 19:29:03 +08:00
one_f_one_b.py [shardformer] support interleaved pipeline (#4448) 2023-08-16 19:29:03 +08:00