ColossalAI/colossalai/pipeline
Ziyue Jiang 400f63012e
[pipeline] Add Simplified Alpa DP Partition (#2507)
* add alpa dp split

* add alpa dp split

* use fwd+bwd instead of fwd only

---------

Co-authored-by: Ziyue Jiang <ziyue.jiang@gmail.com>
2023-03-07 10:34:31 +08:00
..
middleware [Pipeline Middleware] Adapt scheduler for Topo (#2066) 2022-12-05 20:23:41 +08:00
rpc [pipeline] Add Simplified Alpa DP Partition (#2507) 2023-03-07 10:34:31 +08:00
__init__.py fix file name (#1759) 2022-10-25 16:48:48 +08:00
layer_spec.py fix file name (#1759) 2022-10-25 16:48:48 +08:00
pipelinable.py fix file name (#1759) 2022-10-25 16:48:48 +08:00
pipeline_process_group.py [pipeline/fix-bug] num_microbatches support any integrate | stable chimera | launch tool for rpc pp framework (#1684) 2022-10-10 16:01:02 +08:00
utils.py [Pipeline]Adapt to Pipelinable OPT (#1782) 2022-11-01 14:18:50 +08:00