ColossalAI

Commit Graph

Author	SHA1	Message	Date
Frank Lee	edb67cb378	[autoparallel] refactored the data structure for sharding strategy (#1610 )	2022-09-20 11:20:54 +08:00
YuliangLiu0306	eac1b79371	[autoparallel] add bcast op handler (#1600 ) * [autoparallel] add bcast op handler * polish code * add more BCAST FUNC OP * polish code * add exception handler * polish	2022-09-16 11:33:01 +08:00
Frank Lee	3abf98a633	[autoparallel] added all non-bcast matmul strategies (#1603 )	2022-09-16 10:47:32 +08:00
Frank Lee	db98b695b2	[autoparallel] added strategy generator and bmm strategies (#1602 )	2022-09-15 16:57:07 +08:00
YuliangLiu0306	faa23b9d9a	[autoparallel] add reshape handler (#1594 ) * [autoparallel] add reshape handler * polish code	2022-09-14 10:25:45 +08:00
Frank Lee	27fe8af60c	[autoparallel] refactored shape consistency to remove redundancy (#1591 ) * [autoparallel] refactored shape consistency to remove redundancy * polish code * polish code * polish code	2022-09-13 18:30:18 +08:00
YuliangLiu0306	d164449d00	[autoparallel] add resnet autoparallel unit test and add backward weight communication cost (#1589 )	2022-09-13 18:05:05 +08:00
Frank Lee	7c18a588c8	[autoparallel] added generate_sharding_spec to utils (#1590 )	2022-09-13 15:43:22 +08:00
Frank Lee	219f66c571	[autoparallel] added solver option dataclass (#1588 )	2022-09-13 14:47:09 +08:00
YuliangLiu0306	82d4376c23	[autoparallel] adapt solver with resnet (#1583 ) * [autoparallel]adapt solver with resnet * polish code * polish code	2022-09-13 12:07:09 +08:00
YuliangLiu0306	0908d0fc61	[autoparallel]add backward cost info into strategies (#1524 )	2022-09-07 11:19:00 +08:00
YuliangLiu0306	1a3599410d	[autoparallel] support fucntion in operator handler (#1529 )	2022-09-07 11:18:41 +08:00
YuliangLiu0306	44c866a3e3	[autoparallel] change the merge node logic (#1533 )	2022-09-07 11:18:19 +08:00
YuliangLiu0306	3345c6d352	[autoparellel]add strategies constructor (#1505 ) * [autoparellel]add strategies constructor * remove duplicated strategies * polish code * adapt cost graph with StrategiesConstructor * polish	2022-08-30 16:32:09 +08:00
Frank Lee	a0436a62ee	[autoparallel] added liveness analysis (#1516 ) * [autoparallel] added liveness analysis * remove memory cost	2022-08-30 15:54:37 +08:00
YuliangLiu0306	8b7d6bd5be	[autoparallel] add more sharding strategies to conv (#1487 )	2022-08-26 11:17:56 +08:00
YuliangLiu0306	413c053453	[autoparallel] add cost graph class (#1481 ) * [autoparallel] add cost graph class * polish code	2022-08-25 17:19:59 +08:00
Frank Lee	d39e11dffb	[autoparallel] added namespace constraints (#1490 )	2022-08-24 15:44:07 +08:00
Frank Lee	ede326298b	[autoparallel] integrate auto parallel with torch fx (#1479 )	2022-08-23 14:23:08 +08:00
Frank Lee	628c7e3fc8	[autoparallel] added dot handler (#1475 )	2022-08-22 10:32:17 +08:00
Frank Lee	9dae9bb2bc	[autoparallel] introduced baseclass for op handler and reduced code redundancy (#1471 ) * [autoparallel] introduced baseclass for op handler and reduced code redundancy * polish code	2022-08-19 16:51:38 +08:00
Frank Lee	3a54e1c9b7	[autoparallel] standardize the code structure (#1469 )	2022-08-19 15:51:54 +08:00
YuliangLiu0306	26a37b5cd5	[autoparallel] Add conv handler to generate strategies and costs info for conv (#1467 )	2022-08-19 14:57:23 +08:00

23 Commits (edb67cb378daff3cbb4667ee5f86d530e34b8982)