YuliangLiu0306
|
56088e6d98
|
[autoparallel] add pooling handler (#1690)
* [autoparallel] add pooling handler
* polish code
|
2022-10-13 13:42:13 +08:00 |
YuliangLiu0306
|
319d654f79
|
[autoparallel] where_handler_v2 (#1688)
* where generator
* [autoparallel] where_handler_v2
|
2022-10-13 11:02:22 +08:00 |
Frank Lee
|
4973157ad7
|
[autoparallel] added sharding spec conversion for linear handler (#1687)
|
2022-10-12 11:16:18 +08:00 |
YuliangLiu0306
|
af718e83f2
|
[autoparallel] add reshape handler v2 and fix some previous bug (#1683)
|
2022-10-11 18:12:59 +08:00 |
YuliangLiu0306
|
6878e42248
|
[hotfix] solver bug caused by dict type comm cost (#1686)
|
2022-10-11 17:57:03 +08:00 |
YuliangLiu0306
|
517b63939a
|
[autoparallel] add unary element wise handler v2 (#1674)
|
2022-10-09 17:30:42 +08:00 |
YuliangLiu0306
|
f6c6a932b8
|
[autoparallel] add following node generator (#1673)
* [autoparallel] add following node generator
* polish code
* polish code
* update name of arguments
|
2022-10-09 14:49:18 +08:00 |
YuliangLiu0306
|
52fda88796
|
[autoparallel] add layer norm handler v2 (#1671)
* [autoparallel] add layer norm handler v2
* polish code
* polish code
|
2022-10-09 14:23:22 +08:00 |
YuliangLiu0306
|
11ec070e53
|
[hotfix]unit test (#1670)
|
2022-09-29 12:49:28 +08:00 |
Frank Lee
|
a60024e77a
|
[autoparallel] added utils for broadcast operation (#1665)
* [autoparallel] added utils for broadcast operation
* polish code
|
2022-09-29 11:22:29 +08:00 |
YuliangLiu0306
|
3f068d1409
|
[autoparallel] update CommSpec (#1667)
|
2022-09-29 11:20:59 +08:00 |
Frank Lee
|
247a9dbca9
|
[autoparallel] added bias comm spec to matmul strategy (#1664)
|
2022-09-29 11:08:05 +08:00 |
YuliangLiu0306
|
746f8f979d
|
[autoparallel] add batch norm handler v2 (#1666)
|
2022-09-29 11:02:49 +08:00 |
YuliangLiu0306
|
c27e701cb2
|
[autoparallel] remove no strategy nodes (#1652)
* [autoparallel] remove no strategy nodes
* fix none object iteration issue
|
2022-09-29 10:43:25 +08:00 |
Frank Lee
|
50f16a2850
|
[autoparallel] added compute resharding costs for node handler (#1662)
|
2022-09-28 19:55:44 +08:00 |
Frank Lee
|
9ec401a722
|
[autoparallel] added new strategy constructor template (#1661)
* [autoparallel] added new strategy constructor template
* polish code
|
2022-09-28 14:01:36 +08:00 |
Frank Lee
|
3a4d6f63a8
|
[autoparallel] added node handler for bmm (#1655)
|
2022-09-28 11:32:16 +08:00 |
YuliangLiu0306
|
095854477f
|
[autoparallel] add conv handler v2 (#1663)
|
2022-09-28 11:24:59 +08:00 |
YuliangLiu0306
|
1e7816a460
|
[autoparallel] adapt solver with gpt (#1653)
|
2022-09-28 11:17:26 +08:00 |
Frank Lee
|
30e50c8b4a
|
[autoparallel] implemented all matmul strategy generator (#1650)
|
2022-09-27 12:06:25 +08:00 |
YuliangLiu0306
|
03978aad45
|
[autoparallel] change the following nodes strategies generation logic (#1636)
* [autoparallel] change the following nodes strategies generation logic
* fix unit test
|
2022-09-27 11:20:52 +08:00 |
YuliangLiu0306
|
59f100510a
|
[autoparallel] where handler (#1651)
* [autoparallel] where handler
* fix unit test
|
2022-09-27 11:20:43 +08:00 |
Frank Lee
|
45b39a692a
|
[autoparallel] implemented linear projection strategy generator (#1639)
|
2022-09-26 16:58:14 +08:00 |
YuliangLiu0306
|
b2b2a4af98
|
[autoparallel] adapt solver with mlp (#1638)
|
2022-09-26 15:26:14 +08:00 |
YuliangLiu0306
|
702dbc5288
|
[tensor] use communication autograd func (#1617)
* [tensor] use communication autograd func
* change all to all comm spec info
* rename pattern and distinguish fwd/bwd
* polish code
|
2022-09-23 13:31:15 +08:00 |
YuliangLiu0306
|
c7ac0f4ab2
|
[autoparallel] add elementwise handler (#1622)
* [autoparallel] add elementwise handler
* polish code
* polish code
* reduce skipped strategies range
* polish code
|
2022-09-23 13:27:31 +08:00 |
YuliangLiu0306
|
3a46215135
|
[autoparallel] add embedding handler (#1620)
|
2022-09-23 12:34:30 +08:00 |
YuliangLiu0306
|
69448f64c4
|
[autoparallel] protect bcast handler from invalid strategies (#1631)
|
2022-09-23 12:12:49 +08:00 |
YuliangLiu0306
|
0c703189b9
|
[autoparallel] add layernorm handler (#1629)
|
2022-09-23 12:00:25 +08:00 |
YuliangLiu0306
|
bf77d3ab65
|
[autoparallel] recover the merged node strategy index (#1613)
|
2022-09-23 11:52:42 +08:00 |
Frank Lee
|
d925122020
|
[autoparallel] added new linear module handler (#1616)
|
2022-09-21 12:23:21 +08:00 |
YuliangLiu0306
|
6a8f8cc05e
|
[hotfix] got sliced types (#1614)
|
2022-09-20 14:32:42 +08:00 |
Frank Lee
|
d397842fa8
|
[autoparallel] added new node handler (#1612)
|
2022-09-20 14:17:21 +08:00 |
YuliangLiu0306
|
7d1bb71d5d
|
[fx] PoC of runtime shape consistency application (#1607)
* [fx] PoC of runtime shape consistency application
* polish code
|
2022-09-20 14:00:04 +08:00 |
YuliangLiu0306
|
47b11c432c
|
[autoparallel]add bcast matmul strategies (#1605)
|
2022-09-20 11:26:21 +08:00 |
Frank Lee
|
edb67cb378
|
[autoparallel] refactored the data structure for sharding strategy (#1610)
|
2022-09-20 11:20:54 +08:00 |
YuliangLiu0306
|
eac1b79371
|
[autoparallel] add bcast op handler (#1600)
* [autoparallel] add bcast op handler
* polish code
* add more BCAST FUNC OP
* polish code
* add exception handler
* polish
|
2022-09-16 11:33:01 +08:00 |
Frank Lee
|
3abf98a633
|
[autoparallel] added all non-bcast matmul strategies (#1603)
|
2022-09-16 10:47:32 +08:00 |
Frank Lee
|
db98b695b2
|
[autoparallel] added strategy generator and bmm strategies (#1602)
|
2022-09-15 16:57:07 +08:00 |
YuliangLiu0306
|
faa23b9d9a
|
[autoparallel] add reshape handler (#1594)
* [autoparallel] add reshape handler
* polish code
|
2022-09-14 10:25:45 +08:00 |
Frank Lee
|
27fe8af60c
|
[autoparallel] refactored shape consistency to remove redundancy (#1591)
* [autoparallel] refactored shape consistency to remove redundancy
* polish code
* polish code
* polish code
|
2022-09-13 18:30:18 +08:00 |
YuliangLiu0306
|
d164449d00
|
[autoparallel] add resnet autoparallel unit test and add backward weight communication cost (#1589)
|
2022-09-13 18:05:05 +08:00 |
Frank Lee
|
7c18a588c8
|
[autoparallel] added generate_sharding_spec to utils (#1590)
|
2022-09-13 15:43:22 +08:00 |
Frank Lee
|
219f66c571
|
[autoparallel] added solver option dataclass (#1588)
|
2022-09-13 14:47:09 +08:00 |
YuliangLiu0306
|
82d4376c23
|
[autoparallel] adapt solver with resnet (#1583)
* [autoparallel]adapt solver with resnet
* polish code
* polish code
|
2022-09-13 12:07:09 +08:00 |
YuliangLiu0306
|
0908d0fc61
|
[autoparallel]add backward cost info into strategies (#1524)
|
2022-09-07 11:19:00 +08:00 |
YuliangLiu0306
|
1a3599410d
|
[autoparallel] support fucntion in operator handler (#1529)
|
2022-09-07 11:18:41 +08:00 |
YuliangLiu0306
|
44c866a3e3
|
[autoparallel] change the merge node logic (#1533)
|
2022-09-07 11:18:19 +08:00 |
YuliangLiu0306
|
3345c6d352
|
[autoparellel]add strategies constructor (#1505)
* [autoparellel]add strategies constructor
* remove duplicated strategies
* polish code
* adapt cost graph with StrategiesConstructor
* polish
|
2022-08-30 16:32:09 +08:00 |
Frank Lee
|
a0436a62ee
|
[autoparallel] added liveness analysis (#1516)
* [autoparallel] added liveness analysis
* remove memory cost
|
2022-08-30 15:54:37 +08:00 |
YuliangLiu0306
|
8b7d6bd5be
|
[autoparallel] add more sharding strategies to conv (#1487)
|
2022-08-26 11:17:56 +08:00 |
YuliangLiu0306
|
413c053453
|
[autoparallel] add cost graph class (#1481)
* [autoparallel] add cost graph class
* polish code
|
2022-08-25 17:19:59 +08:00 |
Frank Lee
|
d39e11dffb
|
[autoparallel] added namespace constraints (#1490)
|
2022-08-24 15:44:07 +08:00 |
Frank Lee
|
ede326298b
|
[autoparallel] integrate auto parallel with torch fx (#1479)
|
2022-08-23 14:23:08 +08:00 |
Frank Lee
|
628c7e3fc8
|
[autoparallel] added dot handler (#1475)
|
2022-08-22 10:32:17 +08:00 |
Frank Lee
|
9dae9bb2bc
|
[autoparallel] introduced baseclass for op handler and reduced code redundancy (#1471)
* [autoparallel] introduced baseclass for op handler and reduced code redundancy
* polish code
|
2022-08-19 16:51:38 +08:00 |
Frank Lee
|
3a54e1c9b7
|
[autoparallel] standardize the code structure (#1469)
|
2022-08-19 15:51:54 +08:00 |
YuliangLiu0306
|
26a37b5cd5
|
[autoparallel] Add conv handler to generate strategies and costs info for conv (#1467)
|
2022-08-19 14:57:23 +08:00 |