ColossalAI

Commit Graph

Author	SHA1	Message	Date
YuliangLiu0306	21d6a48f4d	[autoparallel] add shard option (#2696 ) * [autoparallel] add shard option * polish	2023-02-15 13:48:28 +08:00
YuliangLiu0306	cb3d1bef62	[autoparallel] adapt autoparallel tests with latest api (#2626 )	2023-02-08 15:02:12 +08:00
YuliangLiu0306	fb87322773	[autoparallel] fix spelling error (#2270 )	2023-01-03 16:13:00 +08:00
Boyuan Yao	d0bc5a1b34	[autoparallel] new metainfoprop based on metainfo class (#2179 ) * [autoparallel] new metainfoprop to combine SPMD solver and checkpoint solver * [autoparallel] new metainfoprop to combine SPMD solver and checkpoint solver * [autoparallel] modify placeholder handler * [autoparallel] modify metainfoprop * [autoparallel] fix function typo * [autoparallel] fix placeholder handler	2022-12-28 13:35:08 +08:00
YuliangLiu0306	cd0af9f7f6	[autoparallel] gpt2lp runtimee test (#2113 )	2022-12-12 18:06:40 +08:00
YuliangLiu0306	1c1fe44305	[autoparallel] adapt solver with self attention (#2037 ) * [autoparallel] adapt solver with self attention * polish code	2022-12-01 17:53:15 +08:00
YuliangLiu0306	1438993113	[autoparallel] add experimental view handler (#2011 ) * [autoparallel] add experimental view handler * polish * polish * polish code * rename variables	2022-11-24 11:34:41 +08:00
YuliangLiu0306	155891113e	[autoparallel] use pytree map style to process data (#1989 )	2022-11-21 10:44:22 +08:00
YuliangLiu0306	0da1d00399	[autoparallel] support distributed dataloader option (#1906 ) * [autoparallel] support distributed dataloader option * update output handler to support ddp dataloader * poish code	2022-11-17 20:11:53 +08:00
YuliangLiu0306	1b494ad73c	[autoparallel] fix linear logical convert issue (#1857 )	2022-11-10 17:19:22 +08:00
YuliangLiu0306	2c4c7b3618	[autoparallel] add getattr handler (#1767 ) * [autoparallel] add getattr haandler * polish code * add extra processes for Parameters * add unit test for param resharding cost * add docstring and polish test	2022-11-03 12:31:33 +08:00
YuliangLiu0306	845ff4a47a	[autoparallel] resnet block runtime apply (#1709 ) * [autoparallel] resnet block runtime apply * seperate buffer and parameter in MemoryCost * polish code * add comments and todos * fix test issue	2022-10-17 13:37:38 +08:00
Frank Lee	6c331a5a09	[autoparallel] refactored the autoparallel module for organization (#1706 ) * [autoparallel] refactored the autoparallel module for organization * polish code	2022-10-14 13:27:00 +08:00

13 Commits (4ee311c0262dfbca9b5da7e18f04dd8f1f23fe4c)