Boyuan Yao
|
cfe2a9bd90
|
[autoparallel] memory estimation for shape consistency (#2144)
* [fx] metainfo class for auto parallel
* [fx] add unit test for linear metainfo
* [fx] fix bwd param for linear
* [fx] modify unit test
* [fx] modify unit test
* [fx] modify import
* [fx] modify import
* [fx] modify import
* [fx] move meta profiler to auto parallel
* [fx] add conv metainfo class
* [fx] restore profiler
* [fx] restore meta profiler
* [autoparallel] modify unit test
* [fx] modify unit test
* [autoparallel] add batchnorm metainfo class
* [autoparallel] fix batchnorm unit test function declaration
* [fx] restore profiler
* [fx] add relu metainfo class
* [fx] restore profiler
* [autoparallel] modify metainfo input
* [autoparallel] add pooling metainfo
* [autoparallel] add F.linear metainfo generator
* [autoparallel] add binary elementwise metainfo
* [fx] recover profiler
* [autoparallel] fix forward memory calculation
* [autoparallel] modify constants.py
* [autoparallel] remove redundant print
* [autoparallel] add F.conv metainfo
* [autoparallel] linear fix
* [autoparallel] memory estimation for communication actions
* [autoparallel] fix docstring
* [autoparallel] fix variables name
|
2022-12-21 10:39:37 +08:00 |
|
Genghan Zhang
|
d655eea515
|
[autoparallel] mix gather (#1977)
* Add mix-gather
* Add comments
* Add comments
* Polish comments
* Change the global rank assumption
* Add tests
* Add two-step tests
* Fix 10 and 01
* Skip test becasue the number of GPUs
|
2022-11-23 21:49:17 +08:00 |
|
Jiarui Fang
|
218c75fd9d
|
[NFC] polish type hint for shape consistency (#1801)
* [NFC] polish type hint for shape consistency
* polish code
* polish code
|
2022-11-07 14:13:03 +08:00 |
|
YuliangLiu0306
|
b4cc59b61e
|
[autoparallel] add numerical test for node strategies (#1760)
* [autoparallel] add numerical test for node strategies
* polish code
* polish code
|
2022-10-27 10:42:54 +08:00 |
|
YuliangLiu0306
|
980ed21723
|
[autoparallel] shard param and buffer as expected (#1753)
* [autoparallel] shard param and buffer as expected
* fix unit test issue
|
2022-10-21 15:45:13 +08:00 |
|
Frank Lee
|
993b8875b6
|
[autoparallel] handled illegal sharding strategy in shape consistency (#1744)
* [autoparallel] handled illegal sharding strategy in shape consistency
* polish code
|
2022-10-20 12:06:25 +08:00 |
|
YuliangLiu0306
|
51b89d2202
|
[autoparallel] runtime_backward_apply (#1720)
|
2022-10-18 10:44:58 +08:00 |
|
YuliangLiu0306
|
3f068d1409
|
[autoparallel] update CommSpec (#1667)
|
2022-09-29 11:20:59 +08:00 |
|
Frank Lee
|
154d3ef432
|
[fix] fixed the collective pattern name for consistency (#1649)
* [fix] fixed the collective pattern name for consistency
* polish code
|
2022-09-26 16:39:37 +08:00 |
|
YuliangLiu0306
|
702dbc5288
|
[tensor] use communication autograd func (#1617)
* [tensor] use communication autograd func
* change all to all comm spec info
* rename pattern and distinguish fwd/bwd
* polish code
|
2022-09-23 13:31:15 +08:00 |
|
Frank Lee
|
27fe8af60c
|
[autoparallel] refactored shape consistency to remove redundancy (#1591)
* [autoparallel] refactored shape consistency to remove redundancy
* polish code
* polish code
* polish code
|
2022-09-13 18:30:18 +08:00 |
|
YuliangLiu0306
|
44c866a3e3
|
[autoparallel] change the merge node logic (#1533)
|
2022-09-07 11:18:19 +08:00 |
|
YuliangLiu0306
|
4b03c25f85
|
[tensor]add 1D device mesh (#1492)
|
2022-08-25 16:48:12 +08:00 |
|
YuliangLiu0306
|
b73fb7a077
|
[tensor] support runtime ShardingSpec apply (#1453)
* [tensor] support runtime ShardingSpec apply
* polish code
* polish code
|
2022-08-19 13:39:51 +08:00 |
|
YuliangLiu0306
|
0f3042363c
|
[tensor] shape consistency generate transform path and communication cost (#1435)
* [tensor] shape consistency output transform path and communication cost
* polish code
|
2022-08-12 14:02:32 +08:00 |
|
YuliangLiu0306
|
33f0744d51
|
[tensor] add shape consistency feature to support auto spec transform (#1418)
* [tensor] add shape consistency feature to supportauto sharding spec transform.
* [tensor] remove unused argument in simulator, add doc string for target pair.
|
2022-08-10 11:29:17 +08:00 |