github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
ColossalAI/colossalai/pipeline
History
Jianghai 376533a564
[shardformer] zero1+pp and the corresponding tests (#4517) 
* pause

* finish pp+zero1

* Update test_shard_vit.py
 		2023-08-28 10:51:16 +08:00
..
middleware [Pipeline Middleware] Adapt scheduler for Topo (#2066) 2022-12-05 20:23:41 +08:00
rpc [nfc]fix typo colossalai/pipeline tensor nn (#3899) 2023-06-06 14:07:36 +08:00
schedule [shardformer] zero1+pp and the corresponding tests (#4517) 2023-08-28 10:51:16 +08:00
__init__.py fix file name (#1759) 2022-10-25 16:48:48 +08:00
layer_spec.py fix file name (#1759) 2022-10-25 16:48:48 +08:00
p2p.py [shardformer] support interleaved pipeline (#4448) 2023-08-16 19:29:03 +08:00
pipelinable.py [nfc]fix typo colossalai/pipeline tensor nn (#3899) 2023-06-06 14:07:36 +08:00
pipeline_process_group.py [pipeline/fix-bug] num_microbatches support any integrate | stable chimera | launch tool for rpc pp framework (#1684) 2022-10-10 16:01:02 +08:00
stage_manager.py [shardformer] support interleaved pipeline (#4448) 2023-08-16 19:29:03 +08:00
utils.py [nfc]fix typo colossalai/pipeline tensor nn (#3899) 2023-06-06 14:07:36 +08:00