ColossalAI/colossalai/pipeline/policy
Jianghai f3bcc292c8 [pipeline] move bert related pipeline components to shardformer (#4187)
* move bert related pipeline components to shardformer

* fix bugs

* revision

* fix bert model tests

* fix bert_lm_head model tests

* fix tests

* fix tests

* done checks

* skip bloom
2023-08-15 23:25:14 +08:00
..
__init__.py [pipeline]add pipeline policy and bert forward (#4130) 2023-08-15 23:25:14 +08:00
base.py [pipeline] move bert related pipeline components to shardformer (#4187) 2023-08-15 23:25:14 +08:00
bert.py [pipeline] add bert_for_pretraining bert_lmhead forward and policy (#4172) 2023-08-15 23:25:14 +08:00
bloom.py [pipeline] build bloom model and policy , revise the base class of policy (#4161) 2023-08-15 23:25:14 +08:00