YuliangLiu0306
|
319d654f79
|
[autoparallel] where_handler_v2 (#1688)
* where generator
* [autoparallel] where_handler_v2
|
2 years ago |
Frank Lee
|
4973157ad7
|
[autoparallel] added sharding spec conversion for linear handler (#1687)
|
2 years ago |
YuliangLiu0306
|
af718e83f2
|
[autoparallel] add reshape handler v2 and fix some previous bug (#1683)
|
2 years ago |
YuliangLiu0306
|
517b63939a
|
[autoparallel] add unary element wise handler v2 (#1674)
|
2 years ago |
YuliangLiu0306
|
f6c6a932b8
|
[autoparallel] add following node generator (#1673)
* [autoparallel] add following node generator
* polish code
* polish code
* update name of arguments
|
2 years ago |
YuliangLiu0306
|
52fda88796
|
[autoparallel] add layer norm handler v2 (#1671)
* [autoparallel] add layer norm handler v2
* polish code
* polish code
|
2 years ago |
YuliangLiu0306
|
11ec070e53
|
[hotfix]unit test (#1670)
|
2 years ago |
Frank Lee
|
a60024e77a
|
[autoparallel] added utils for broadcast operation (#1665)
* [autoparallel] added utils for broadcast operation
* polish code
|
2 years ago |
YuliangLiu0306
|
746f8f979d
|
[autoparallel] add batch norm handler v2 (#1666)
|
2 years ago |
Frank Lee
|
3a4d6f63a8
|
[autoparallel] added node handler for bmm (#1655)
|
2 years ago |
YuliangLiu0306
|
095854477f
|
[autoparallel] add conv handler v2 (#1663)
|
2 years ago |
YuliangLiu0306
|
1e7816a460
|
[autoparallel] adapt solver with gpt (#1653)
|
2 years ago |
Frank Lee
|
30e50c8b4a
|
[autoparallel] implemented all matmul strategy generator (#1650)
|
2 years ago |
YuliangLiu0306
|
03978aad45
|
[autoparallel] change the following nodes strategies generation logic (#1636)
* [autoparallel] change the following nodes strategies generation logic
* fix unit test
|
2 years ago |
YuliangLiu0306
|
59f100510a
|
[autoparallel] where handler (#1651)
* [autoparallel] where handler
* fix unit test
|
2 years ago |
Frank Lee
|
45b39a692a
|
[autoparallel] implemented linear projection strategy generator (#1639)
|
2 years ago |
YuliangLiu0306
|
b2b2a4af98
|
[autoparallel] adapt solver with mlp (#1638)
|
2 years ago |
YuliangLiu0306
|
0c703189b9
|
[autoparallel] add layernorm handler (#1629)
|
2 years ago |
YuliangLiu0306
|
bf77d3ab65
|
[autoparallel] recover the merged node strategy index (#1613)
|
2 years ago |
YuliangLiu0306
|
9eae855408
|
[hotfix] add recompile after graph manipulatation (#1621)
|
2 years ago |
Frank Lee
|
d925122020
|
[autoparallel] added new linear module handler (#1616)
|
2 years ago |
YuliangLiu0306
|
7d1bb71d5d
|
[fx] PoC of runtime shape consistency application (#1607)
* [fx] PoC of runtime shape consistency application
* polish code
|
2 years ago |
YuliangLiu0306
|
47b11c432c
|
[autoparallel]add bcast matmul strategies (#1605)
|
2 years ago |
YuliangLiu0306
|
eac1b79371
|
[autoparallel] add bcast op handler (#1600)
* [autoparallel] add bcast op handler
* polish code
* add more BCAST FUNC OP
* polish code
* add exception handler
* polish
|
2 years ago |
YuliangLiu0306
|
faa23b9d9a
|
[autoparallel] add reshape handler (#1594)
* [autoparallel] add reshape handler
* polish code
|
2 years ago |
Frank Lee
|
27fe8af60c
|
[autoparallel] refactored shape consistency to remove redundancy (#1591)
* [autoparallel] refactored shape consistency to remove redundancy
* polish code
* polish code
* polish code
|
2 years ago |
YuliangLiu0306
|
d164449d00
|
[autoparallel] add resnet autoparallel unit test and add backward weight communication cost (#1589)
|
2 years ago |
Frank Lee
|
219f66c571
|
[autoparallel] added solver option dataclass (#1588)
|
2 years ago |
YuliangLiu0306
|
82d4376c23
|
[autoparallel] adapt solver with resnet (#1583)
* [autoparallel]adapt solver with resnet
* polish code
* polish code
|
2 years ago |
YuliangLiu0306
|
0908d0fc61
|
[autoparallel]add backward cost info into strategies (#1524)
|
2 years ago |
YuliangLiu0306
|
44c866a3e3
|
[autoparallel] change the merge node logic (#1533)
|
2 years ago |
YuliangLiu0306
|
3345c6d352
|
[autoparellel]add strategies constructor (#1505)
* [autoparellel]add strategies constructor
* remove duplicated strategies
* polish code
* adapt cost graph with StrategiesConstructor
* polish
|
2 years ago |
Frank Lee
|
a0436a62ee
|
[autoparallel] added liveness analysis (#1516)
* [autoparallel] added liveness analysis
* remove memory cost
|
2 years ago |
YuliangLiu0306
|
8b7d6bd5be
|
[autoparallel] add more sharding strategies to conv (#1487)
|
2 years ago |
YuliangLiu0306
|
413c053453
|
[autoparallel] add cost graph class (#1481)
* [autoparallel] add cost graph class
* polish code
|
2 years ago |
Frank Lee
|
ede326298b
|
[autoparallel] integrate auto parallel with torch fx (#1479)
|
2 years ago |
Frank Lee
|
628c7e3fc8
|
[autoparallel] added dot handler (#1475)
|
2 years ago |
YuliangLiu0306
|
26a37b5cd5
|
[autoparallel] Add conv handler to generate strategies and costs info for conv (#1467)
|
2 years ago |