YuliangLiu0306
|
845ff4a47a
|
[autoparallel] resnet block runtime apply (#1709)
* [autoparallel] resnet block runtime apply
* seperate buffer and parameter in MemoryCost
* polish code
* add comments and todos
* fix test issue
|
2 years ago |
Frank Lee
|
22a115406b
|
[autoparallel] fixed broken node handler tests (#1708)
|
2 years ago |
Frank Lee
|
6c331a5a09
|
[autoparallel] refactored the autoparallel module for organization (#1706)
* [autoparallel] refactored the autoparallel module for organization
* polish code
|
2 years ago |
YuliangLiu0306
|
451cd72dea
|
[autoparallel] adapt runtime passes (#1703)
* [autoparallel] adapt runtime passes v2
* polish code
|
2 years ago |
Frank Lee
|
8283e95db3
|
[autoparallel] collated all deprecated files (#1700)
* [autoparallel] collated all deprecated files
* polish code
|
2 years ago |
Frank Lee
|
e2355d01b9
|
[autoparallel] init new folder structure (#1696)
|
2 years ago |
YuliangLiu0306
|
81f7530ee7
|
[autoparallel] adapt solver and CostGraph with new handler (#1695)
* [autoparallel] adapt solver and CostGraph with new handler
* fix test issue
|
2 years ago |
YuliangLiu0306
|
42b882ef06
|
[autoparallel] add output handler and placeholder handler (#1694)
* [autoparallel] add output handler and placeholder handler
* Delete test_solver_with_resnet.py
* fix test bugs
|
2 years ago |
YuliangLiu0306
|
56088e6d98
|
[autoparallel] add pooling handler (#1690)
* [autoparallel] add pooling handler
* polish code
|
2 years ago |
YuliangLiu0306
|
319d654f79
|
[autoparallel] where_handler_v2 (#1688)
* where generator
* [autoparallel] where_handler_v2
|
2 years ago |
Frank Lee
|
4973157ad7
|
[autoparallel] added sharding spec conversion for linear handler (#1687)
|
2 years ago |
YuliangLiu0306
|
af718e83f2
|
[autoparallel] add reshape handler v2 and fix some previous bug (#1683)
|
2 years ago |
YuliangLiu0306
|
6878e42248
|
[hotfix] solver bug caused by dict type comm cost (#1686)
|
2 years ago |
YuliangLiu0306
|
517b63939a
|
[autoparallel] add unary element wise handler v2 (#1674)
|
2 years ago |
YuliangLiu0306
|
f6c6a932b8
|
[autoparallel] add following node generator (#1673)
* [autoparallel] add following node generator
* polish code
* polish code
* update name of arguments
|
2 years ago |
YuliangLiu0306
|
52fda88796
|
[autoparallel] add layer norm handler v2 (#1671)
* [autoparallel] add layer norm handler v2
* polish code
* polish code
|
2 years ago |
YuliangLiu0306
|
11ec070e53
|
[hotfix]unit test (#1670)
|
2 years ago |
Frank Lee
|
a60024e77a
|
[autoparallel] added utils for broadcast operation (#1665)
* [autoparallel] added utils for broadcast operation
* polish code
|
2 years ago |
YuliangLiu0306
|
3f068d1409
|
[autoparallel] update CommSpec (#1667)
|
2 years ago |
Frank Lee
|
247a9dbca9
|
[autoparallel] added bias comm spec to matmul strategy (#1664)
|
2 years ago |
YuliangLiu0306
|
746f8f979d
|
[autoparallel] add batch norm handler v2 (#1666)
|
2 years ago |
YuliangLiu0306
|
c27e701cb2
|
[autoparallel] remove no strategy nodes (#1652)
* [autoparallel] remove no strategy nodes
* fix none object iteration issue
|
2 years ago |
Frank Lee
|
50f16a2850
|
[autoparallel] added compute resharding costs for node handler (#1662)
|
2 years ago |
Frank Lee
|
9ec401a722
|
[autoparallel] added new strategy constructor template (#1661)
* [autoparallel] added new strategy constructor template
* polish code
|
2 years ago |
Frank Lee
|
3a4d6f63a8
|
[autoparallel] added node handler for bmm (#1655)
|
2 years ago |
YuliangLiu0306
|
095854477f
|
[autoparallel] add conv handler v2 (#1663)
|
2 years ago |
YuliangLiu0306
|
1e7816a460
|
[autoparallel] adapt solver with gpt (#1653)
|
2 years ago |
Frank Lee
|
30e50c8b4a
|
[autoparallel] implemented all matmul strategy generator (#1650)
|
2 years ago |
YuliangLiu0306
|
03978aad45
|
[autoparallel] change the following nodes strategies generation logic (#1636)
* [autoparallel] change the following nodes strategies generation logic
* fix unit test
|
2 years ago |
YuliangLiu0306
|
59f100510a
|
[autoparallel] where handler (#1651)
* [autoparallel] where handler
* fix unit test
|
2 years ago |
Frank Lee
|
45b39a692a
|
[autoparallel] implemented linear projection strategy generator (#1639)
|
2 years ago |
YuliangLiu0306
|
b2b2a4af98
|
[autoparallel] adapt solver with mlp (#1638)
|
2 years ago |
YuliangLiu0306
|
702dbc5288
|
[tensor] use communication autograd func (#1617)
* [tensor] use communication autograd func
* change all to all comm spec info
* rename pattern and distinguish fwd/bwd
* polish code
|
2 years ago |
YuliangLiu0306
|
c7ac0f4ab2
|
[autoparallel] add elementwise handler (#1622)
* [autoparallel] add elementwise handler
* polish code
* polish code
* reduce skipped strategies range
* polish code
|
2 years ago |
YuliangLiu0306
|
3a46215135
|
[autoparallel] add embedding handler (#1620)
|
2 years ago |
YuliangLiu0306
|
69448f64c4
|
[autoparallel] protect bcast handler from invalid strategies (#1631)
|
2 years ago |
YuliangLiu0306
|
0c703189b9
|
[autoparallel] add layernorm handler (#1629)
|
2 years ago |
YuliangLiu0306
|
bf77d3ab65
|
[autoparallel] recover the merged node strategy index (#1613)
|
2 years ago |
Frank Lee
|
d925122020
|
[autoparallel] added new linear module handler (#1616)
|
2 years ago |
YuliangLiu0306
|
6a8f8cc05e
|
[hotfix] got sliced types (#1614)
|
2 years ago |
Frank Lee
|
d397842fa8
|
[autoparallel] added new node handler (#1612)
|
2 years ago |
YuliangLiu0306
|
7d1bb71d5d
|
[fx] PoC of runtime shape consistency application (#1607)
* [fx] PoC of runtime shape consistency application
* polish code
|
2 years ago |
YuliangLiu0306
|
47b11c432c
|
[autoparallel]add bcast matmul strategies (#1605)
|
2 years ago |
Frank Lee
|
edb67cb378
|
[autoparallel] refactored the data structure for sharding strategy (#1610)
|
2 years ago |
YuliangLiu0306
|
eac1b79371
|
[autoparallel] add bcast op handler (#1600)
* [autoparallel] add bcast op handler
* polish code
* add more BCAST FUNC OP
* polish code
* add exception handler
* polish
|
2 years ago |
Frank Lee
|
3abf98a633
|
[autoparallel] added all non-bcast matmul strategies (#1603)
|
2 years ago |
Frank Lee
|
db98b695b2
|
[autoparallel] added strategy generator and bmm strategies (#1602)
|
2 years ago |
YuliangLiu0306
|
faa23b9d9a
|
[autoparallel] add reshape handler (#1594)
* [autoparallel] add reshape handler
* polish code
|
2 years ago |
Frank Lee
|
27fe8af60c
|
[autoparallel] refactored shape consistency to remove redundancy (#1591)
* [autoparallel] refactored shape consistency to remove redundancy
* polish code
* polish code
* polish code
|
2 years ago |
YuliangLiu0306
|
d164449d00
|
[autoparallel] add resnet autoparallel unit test and add backward weight communication cost (#1589)
|
2 years ago |
Frank Lee
|
7c18a588c8
|
[autoparallel] added generate_sharding_spec to utils (#1590)
|
2 years ago |
Frank Lee
|
219f66c571
|
[autoparallel] added solver option dataclass (#1588)
|
2 years ago |
YuliangLiu0306
|
82d4376c23
|
[autoparallel] adapt solver with resnet (#1583)
* [autoparallel]adapt solver with resnet
* polish code
* polish code
|
2 years ago |
YuliangLiu0306
|
0908d0fc61
|
[autoparallel]add backward cost info into strategies (#1524)
|
2 years ago |
YuliangLiu0306
|
1a3599410d
|
[autoparallel] support fucntion in operator handler (#1529)
|
2 years ago |
YuliangLiu0306
|
44c866a3e3
|
[autoparallel] change the merge node logic (#1533)
|
2 years ago |
YuliangLiu0306
|
3345c6d352
|
[autoparellel]add strategies constructor (#1505)
* [autoparellel]add strategies constructor
* remove duplicated strategies
* polish code
* adapt cost graph with StrategiesConstructor
* polish
|
2 years ago |
Frank Lee
|
a0436a62ee
|
[autoparallel] added liveness analysis (#1516)
* [autoparallel] added liveness analysis
* remove memory cost
|
2 years ago |
YuliangLiu0306
|
8b7d6bd5be
|
[autoparallel] add more sharding strategies to conv (#1487)
|
2 years ago |
YuliangLiu0306
|
413c053453
|
[autoparallel] add cost graph class (#1481)
* [autoparallel] add cost graph class
* polish code
|
2 years ago |
Frank Lee
|
d39e11dffb
|
[autoparallel] added namespace constraints (#1490)
|
2 years ago |
Frank Lee
|
ede326298b
|
[autoparallel] integrate auto parallel with torch fx (#1479)
|
2 years ago |
Frank Lee
|
628c7e3fc8
|
[autoparallel] added dot handler (#1475)
|
2 years ago |
Frank Lee
|
9dae9bb2bc
|
[autoparallel] introduced baseclass for op handler and reduced code redundancy (#1471)
* [autoparallel] introduced baseclass for op handler and reduced code redundancy
* polish code
|
2 years ago |
Frank Lee
|
3a54e1c9b7
|
[autoparallel] standardize the code structure (#1469)
|
2 years ago |
YuliangLiu0306
|
26a37b5cd5
|
[autoparallel] Add conv handler to generate strategies and costs info for conv (#1467)
|
2 years ago |