ColossalAI/colossalai/pipeline/rpc
Ziyue Jiang 400f63012e
[pipeline] Add Simplified Alpa DP Partition (#2507)
* add alpa dp split

* add alpa dp split

* use fwd+bwd instead of fwd only

---------

Co-authored-by: Ziyue Jiang <ziyue.jiang@gmail.com>
2023-03-07 10:34:31 +08:00
..
__init__.py [pipeline/pytree] add pytree to process args and kwargs | provide `data_process_func` to process args and kwargs after forward (#1642) 2022-09-29 10:58:58 +08:00
_pipeline_base.py [pipeline] Add Simplified Alpa DP Partition (#2507) 2023-03-07 10:34:31 +08:00
_pipeline_schedule.py polish pp middleware (#2476) 2023-01-13 16:56:01 +08:00
utils.py fix type of num_worker_threads (#2237) 2022-12-30 11:04:01 +08:00