Jianghai 376533a564 [shardformer] zero1+pp and the corresponding tests (#4517) ... * pause * finish pp+zero1 * Update test_shard_vit.py		2023-08-28 10:51:16 +08:00
..
__init__.py	[pipeline] refactor 1f1b schedule (#4115)	2023-08-15 23:25:14 +08:00
_utils.py	[pipeline] rewrite t5 tests & support multi-tensor transmitting in pipeline (#4388)	2023-08-15 23:25:14 +08:00
base.py	[pipeline] refactor 1f1b schedule (#4115)	2023-08-15 23:25:14 +08:00
interleaved_pp.py	[shardformer] support interleaved pipeline (#4448)	2023-08-16 19:29:03 +08:00
one_f_one_b.py	[shardformer] zero1+pp and the corresponding tests (#4517)	2023-08-28 10:51:16 +08:00