ColossalAI

Author	SHA1	Message	Date
Ziyue Jiang	400f63012e	[pipeline] Add Simplified Alpa DP Partition (#2507 ) * add alpa dp split * add alpa dp split * use fwd+bwd instead of fwd only --------- Co-authored-by: Ziyue Jiang <ziyue.jiang@gmail.com>	2023-03-07 10:34:31 +08:00
binmakeswell	fcc6d61d92	[example] fix requirements (#2488 )	2023-01-17 13:07:25 +08:00
Ziyue Jiang	fef5c949c3	polish pp middleware (#2476 ) Co-authored-by: Ziyue Jiang <ziyue.jiang@gmail.com>	2023-01-13 16:56:01 +08:00
YuliangLiu0306	2731531bc2	[autoparallel] integrate device mesh initialization into autoparallelize (#2393 ) * [autoparallel] integrate device mesh initialization into autoparallelize * add megatron solution * update gpt autoparallel examples with latest api * adapt beta value to fit the current computation cost	2023-01-11 14:03:49 +08:00
Ziyue Jiang	ad00894f7f	polish	2023-01-06 16:03:16 +08:00
Ziyue Jiang	3a15b20421	Move GPT PP Example	2023-01-06 14:48:58 +08:00
YuliangLiu0306	8b1e0dfd80	[example] upload auto parallel gpt2 demo (#2354 )	2023-01-06 11:38:38 +08:00