ColossalAI/colossalai/pipeline
Jianghai f3bcc292c8 [pipeline] move bert related pipeline components to shardformer (#4187)
* move bert related pipeline components to shardformer

* fix bugs

* revision

* fix bert model tests

* fix bert_lm_head model tests

* fix tests

* fix tests

* done checks

* skip bloom
2023-08-15 23:25:14 +08:00
..
middleware [Pipeline Middleware] Adapt scheduler for Topo (#2066) 2022-12-05 20:23:41 +08:00
policy [pipeline] move bert related pipeline components to shardformer (#4187) 2023-08-15 23:25:14 +08:00
rpc [nfc]fix typo colossalai/pipeline tensor nn (#3899) 2023-06-06 14:07:36 +08:00
schedule [pipeline] refactor 1f1b schedule (#4115) 2023-08-15 23:25:14 +08:00
__init__.py fix file name (#1759) 2022-10-25 16:48:48 +08:00
layer_spec.py fix file name (#1759) 2022-10-25 16:48:48 +08:00
p2p.py [pipeline] implement p2p communication (#4100) 2023-08-15 23:25:14 +08:00
pipelinable.py [nfc]fix typo colossalai/pipeline tensor nn (#3899) 2023-06-06 14:07:36 +08:00
pipeline_process_group.py
stage_manager.py [pipeline] add stage manager (#4093) 2023-08-15 23:25:14 +08:00
utils.py [nfc]fix typo colossalai/pipeline tensor nn (#3899) 2023-06-06 14:07:36 +08:00