ColossalAI/colossalai/cluster
LuGY a78daf6180
[shardformer] support interleaved pipeline (#4448)
* support interleaved pipeline

* fix unit test

* remove virtual stage test in stage mgr

* add droped type hint and updated bwd
2023-08-16 19:29:03 +08:00
..
__init__.py [cluster] add process group mesh (#4039) 2023-08-15 23:25:14 +08:00
device_mesh_manager.py [API] implement device mesh manager (#3221) 2023-03-24 13:39:12 +08:00
dist_coordinator.py fix typo colossalai/auto_parallel autochunk fx/passes etc. (#3808) 2023-05-24 09:01:50 +08:00
process_group_manager.py [booster] implemented the cluster module (#3191) 2023-03-22 14:11:54 +08:00
process_group_mesh.py [shardformer] support interleaved pipeline (#4448) 2023-08-16 19:29:03 +08:00