ColossalAI

Commit Graph

Author	SHA1	Message	Date
digger yu	7f8203af69	fix typo colossalai/auto_parallel autochunk fx/passes etc. (#3808 )	2023-05-24 09:01:50 +08:00
digger yu	1baeb39c72	[NFC] fix typo with colossalai/auto_parallel/tensor_shard (#3742 ) * fix typo applications/ and colossalai/ date 5.11 * fix typo colossalai/	2023-05-17 11:13:23 +08:00
YuliangLiu0306	fee2af8610	[autoparallel] adapt autoparallel with new analyzer (#3261 ) * [autoparallel] adapt autoparallel with new analyzer * fix all node handler tests * polish * polish	2023-03-30 17:47:24 +08:00
YuliangLiu0306	47fb214b3b	[hotfix] add shard dim to aviod backward communication error (#2954 )	2023-03-01 11:41:53 +08:00
YuliangLiu0306	1dc003c169	[autoparallel] distinguish different parallel strategies (#2699 )	2023-02-15 22:28:28 +08:00
YuliangLiu0306	37df666f38	[autoparallel] refactor handlers which reshape input tensors (#2615 ) * [autoparallel] refactor handlers which reshape input tensors * polish	2023-02-08 15:02:49 +08:00
YuliangLiu0306	cb3d1bef62	[autoparallel] adapt autoparallel tests with latest api (#2626 )	2023-02-08 15:02:12 +08:00
YuliangLiu0306	aa0f6686f9	[autoparallel] accelerate gpt2 training (#2495 )	2023-01-29 11:13:15 +08:00
YuliangLiu0306	78509124d3	[autoparallel] update getitem handler (#2207 )	2022-12-27 19:58:32 +08:00
YuliangLiu0306	4851f2d607	[autoparallel] update_getattr_handler (#2193 )	2022-12-26 21:57:39 +08:00
YuliangLiu0306	536560ccc0	[autoparallel] implement softmax handler (#2132 )	2022-12-14 16:09:53 +08:00
YuliangLiu0306	d3d4630495	[autoparallel] add sum handler (#2101 )	2022-12-08 17:02:54 +08:00
YuliangLiu0306	7f72eb0510	[autoparallel]add embedding handler (#2089 ) * [autoparallel] add embedding handler * fix bugs	2022-12-07 09:41:46 +08:00
YuliangLiu0306	0e9db368ef	[autoparallel] add tensor constructor handler (#2082 )	2022-12-06 10:20:10 +08:00
YuliangLiu0306	cdf537a648	[autoparallel] add non_split linear strategy (#2078 ) * [autoparallel] add non_split linear stategy * polish	2022-12-06 10:19:33 +08:00
YuliangLiu0306	f123476666	[autoparallel] complete gpt block searching (#2065 ) * [autoparallel] complete gpt block searching * fix test	2022-12-06 10:17:10 +08:00
YuliangLiu0306	0dbcd4a6f5	[autoparallel] add split handler (#2032 ) * [autoparallel] add split handler * add numerical test and runtime passes	2022-11-29 11:03:51 +08:00
YuliangLiu0306	155891113e	[autoparallel] use pytree map style to process data (#1989 )	2022-11-21 10:44:22 +08:00
YuliangLiu0306	35e6b9ec82	[autoparallel] adapt handlers with attention block (#1990 ) * [autoparallel] adapt handlers with attention block * polish	2022-11-21 10:44:11 +08:00
YuliangLiu0306	05020e50d0	[autoparallel] support more flexible data type (#1967 )	2022-11-18 17:01:06 +08:00
YuliangLiu0306	0da1d00399	[autoparallel] support distributed dataloader option (#1906 ) * [autoparallel] support distributed dataloader option * update output handler to support ddp dataloader * poish code	2022-11-17 20:11:53 +08:00
YuliangLiu0306	fea3cb661c	[autoparallel] support addmm in tracer and solver (#1961 ) * [fx] patch addmm * [autoparallel] support addmm in tracer and solver	2022-11-16 14:59:18 +08:00
YuliangLiu0306	36c0f3ea5b	[autoparallel] remove redundancy comm node (#1893 )	2022-11-15 10:53:41 +08:00
YuliangLiu0306	49216d7ab1	[autoparallel] fix bugs caused by negative dim key (#1808 ) * [autoparallel] fix bugs caused by negative dim key * fix import error * fix matmul test issue * fix unit test issue	2022-11-08 17:03:50 +08:00
YuliangLiu0306	f6032ddb17	[autoparallel] fix bias addition module (#1800 )	2022-11-08 16:21:25 +08:00
YuliangLiu0306	2c4c7b3618	[autoparallel] add getattr handler (#1767 ) * [autoparallel] add getattr haandler * polish code * add extra processes for Parameters * add unit test for param resharding cost * add docstring and polish test	2022-11-03 12:31:33 +08:00
Frank Lee	f3f19a5c47	[autoparallel] added matmul handler (#1763 ) * [autoparallel] added matmul handler * polish code	2022-11-01 15:14:53 +08:00
YuliangLiu0306	27de252334	[autoparallel] fix conv handler numerical test (#1771 )	2022-11-01 10:43:44 +08:00
YuliangLiu0306	b0f7c8bde8	[autoparallel] update CommSpec to CommActions (#1768 ) * [autoparallel] update CommSpec to CommActions * polish code	2022-10-28 09:57:43 +08:00
YuliangLiu0306	b4cc59b61e	[autoparallel] add numerical test for node strategies (#1760 ) * [autoparallel] add numerical test for node strategies * polish code * polish code	2022-10-27 10:42:54 +08:00
Frank Lee	f9a613d660	[autoparallel] added binary elementwise node handler (#1758 ) * [autoparallel] added binary elementwise node handler * polish code	2022-10-25 14:32:01 +08:00
Frank Lee	262652c8bc	[autoparallel] added addbmm handler (#1751 )	2022-10-21 18:55:48 +08:00
YuliangLiu0306	a4ce180e85	[autoparallel] add sequential order to communication actions (#1735 )	2022-10-20 18:48:18 +08:00
Frank Lee	8b8937d901	[autoparallel] fixed wrong generated strategy for dot op (#1746 ) * [autoparallel] fixed wrong generated strategy for dot op * polish code	2022-10-20 15:18:16 +08:00
Frank Lee	88a79814fb	[autoparallel] handled illegal strategy in node handler (#1743 ) * [autoparallel] handled illegal strategy in node handler * polish code	2022-10-19 17:08:52 +08:00
Frank Lee	eee84908d4	[autoparallel] handled illegal sharding strategy (#1728 ) * [autoparallel] handled illegal sharding strategy * polish code	2022-10-19 12:53:06 +08:00
YuliangLiu0306	845ff4a47a	[autoparallel] resnet block runtime apply (#1709 ) * [autoparallel] resnet block runtime apply * seperate buffer and parameter in MemoryCost * polish code * add comments and todos * fix test issue	2022-10-17 13:37:38 +08:00
Frank Lee	22a115406b	[autoparallel] fixed broken node handler tests (#1708 )	2022-10-14 18:25:59 +08:00
Frank Lee	6c331a5a09	[autoparallel] refactored the autoparallel module for organization (#1706 ) * [autoparallel] refactored the autoparallel module for organization * polish code	2022-10-14 13:27:00 +08:00

39 Commits (33eef714db460d3db42698a2d969cb6a669dc583)