ColossalAI/colossalai/booster
Bin Jia 7c8be77081
[shardformer/sequence parallel] support gpt2 seq parallel with pp/dp/tp (#4460)
* support gpt2 seq parallel with pp/dp/tp

* fix a bug when waiting for stream done

* delete unused gpt2_seq file
2023-08-18 11:21:53 +08:00
..
mixed_precision [NFC] Fix format for mixed precision (#4253) 2023-07-26 14:12:57 +08:00
plugin [shardformer/sequence parallel] support gpt2 seq parallel with pp/dp/tp (#4460) 2023-08-18 11:21:53 +08:00
__init__.py
accelerator.py
booster.py [misc] resolve code factor issues (#4433) 2023-08-15 23:25:14 +08:00