ColossalAI/colossalai/shardformer/shard
Jianghai 1094e0f0d3 [pipeline] Bert pipeline for shardformer and its tests (#4197)
* add pipeline forward

* complete pipeline forward check

* fix bert forward without pipeline

* fix comments

* discard useless line

* add todo

* clean prints

* fix distribute layers
2023-08-15 23:25:14 +08:00
..
__init__.py [shardformer] Refactor shardformer api (#4001) 2023-07-04 16:05:01 +08:00
shard_config.py [shardformer] fix type hint 2023-08-15 23:25:14 +08:00
sharder.py [pipeline] Bert pipeline for shardformer and its tests (#4197) 2023-08-15 23:25:14 +08:00
shardformer.py [shardformer] rename policy file name 2023-08-15 23:25:14 +08:00
utils.py [pipeline] update shardformer policy 2023-08-15 23:25:14 +08:00