digger yu
|
32f81f14d4
|
[NFC] fix typo colossalai/amp auto_parallel autochunk (#3756)
|
2 years ago |
|
YuliangLiu0306
|
ffcdbf0f65
|
[autoparallel]integrate auto parallel feature with new tracer (#3408)
* [autoparallel] integrate new analyzer in module level
* unify the profiling method
* polish
* fix no codegen bug
* fix pass bug
* fix liveness test
* polish
|
2 years ago |
|
YuliangLiu0306
|
67e1912b59
|
[autoparallel] support origin activation ckpt on autoprallel system (#2468)
|
2 years ago |
|
Boyuan Yao
|
ab38aebace
|
[autoparallel] Hook all meta information on ResNet nodes for auto activation checkpoint (#2248)
* [autoparallel] hook node meta on graph nodes for checkpoint solver
* [autoparallel] polish code
* [autoparallel] restore some node handlers
* colossalai/auto_parallel/passes/meta_info_prop.py
* [autoparallel] remove some unused import
* [autoparallel] hook bwd_mem_out
|
2 years ago |
|
Super Daniel
|
b7d0990c61
|
[autoparallel] fix construct meta info. (#2245)
|
2 years ago |
|
YuliangLiu0306
|
3b1b91eaf4
|
[autoparallel] record parameter attribute in colotracer (#2217)
* [autoparallel] record parameter attribute in collotracer
* [autoparallel] fix construct_meta_info bug
|
2 years ago |
|
Boyuan Yao
|
24246f7aa5
|
[autoparallel] Attach input, buffer and output tensor to MetaInfo class (#2162)
* [fx] metainfo class for auto parallel
* [fx] add unit test for linear metainfo
* [fx] fix bwd param for linear
* [fx] modify unit test
* [fx] modify unit test
* [fx] modify import
* [fx] modify import
* [fx] modify import
* [fx] move meta profiler to auto parallel
* [fx] add conv metainfo class
* [fx] restore profiler
* [fx] restore meta profiler
* [autoparallel] modify unit test
* [fx] modify unit test
* [autoparallel] add batchnorm metainfo class
* [autoparallel] fix batchnorm unit test function declaration
* [fx] restore profiler
* [fx] add relu metainfo class
* [fx] restore profiler
* [autoparallel] modify metainfo input
* [autoparallel] add pooling metainfo
* [autoparallel] add F.linear metainfo generator
* [autoparallel] add binary elementwise metainfo
* [fx] recover profiler
* [autoparallel] fix forward memory calculation
* [autoparallel] modify constants.py
* [autoparallel] remove redundant print
* [autoparallel] add F.conv metainfo
* [autoparallel] linear fix
* [autoparallel] memory estimation for communication actions
* [autoparallel] fix docstring
* [autoparallel] fix variables name
* [autoparallel] attach tensor to metainfo class
* [autoparallel] fix dangerous try except
* [autoparallel] attach memory cost to shape consistency node
* [autoparallel] attach shape consistency node's metainfo to the node
* [autoparallel] remove todo in shape consistency memory estimation
* [autoparallel] fix the annotation
|
2 years ago |
|
YuliangLiu0306
|
0dbcd4a6f5
|
[autoparallel] add split handler (#2032)
* [autoparallel] add split handler
* add numerical test and runtime passes
|
2 years ago |
|
YuliangLiu0306
|
36c0f3ea5b
|
[autoparallel] remove redundancy comm node (#1893)
|
2 years ago |
|
YuliangLiu0306
|
f6032ddb17
|
[autoparallel] fix bias addition module (#1800)
|
2 years ago |
|
YuliangLiu0306
|
b4cc59b61e
|
[autoparallel] add numerical test for node strategies (#1760)
* [autoparallel] add numerical test for node strategies
* polish code
* polish code
|
2 years ago |
|
YuliangLiu0306
|
314d8c497f
|
[autoparallel] refactor the runtime apply pass and add docstring to passes (#1757)
* [autoparallel] refactor the runtime apply pass and add doc string to passes
* fix unit test
* polish
|
2 years ago |
