ColossalAI/colossalai/zero
flybird11111 ec18fc7340
[shardformer] support pp+tp+zero1 tests (#4531)
* [shardformer] fix opt test hanging

* fix

* test

* test

* test

* fix test

* fix test

* remove print

* add fix

* [shardformer] pp+tp+zero1

[shardformer] pp+tp+zero1

[shardformer] pp+tp+zero1

[shardformer] pp+tp+zero1

[shardformer] pp+tp+zero1

[shardformer] pp+tp+zero1

* [shardformer] pp+tp+zero1

* [shardformer] pp+tp+zero1

* [shardformer] pp+tp+zero1

* [shardformer] pp+tp+zero1
2023-08-30 21:29:18 +08:00
..
gemini [shardformer] support sharded checkpoint IO for models of HybridParallelPlugin (#4506) 2023-08-25 22:04:57 +08:00
legacy [nfc] fix typo colossalai/zero (#3923) 2023-06-08 00:01:29 +08:00
low_level [shardformer] support pp+tp+zero1 tests (#4531) 2023-08-30 21:29:18 +08:00
__init__.py [zero] reorganize zero/gemini folder structure (#3424) 2023-04-04 13:48:16 +08:00
wrapper.py [doc] Fix typo under colossalai and doc(#3618) 2023-04-26 11:38:43 +08:00