ColossalAI/colossalai/auto_parallel/tensor_shard
Boyuan Yao cfe2a9bd90
[autoparallel] memory estimation for shape consistency (#2144)
* [fx] metainfo class for auto parallel

* [fx] add unit test for linear metainfo

* [fx] fix bwd param for linear

* [fx] modify unit test

* [fx] modify unit test

* [fx] modify import

* [fx] modify import

* [fx] modify import

* [fx] move meta profiler to auto parallel

* [fx] add conv metainfo class

* [fx] restore profiler

* [fx] restore meta profiler

* [autoparallel] modify unit test

* [fx] modify unit test

* [autoparallel] add batchnorm metainfo class

* [autoparallel] fix batchnorm unit test function declaration

* [fx] restore profiler

* [fx] add relu metainfo class

* [fx] restore profiler

* [autoparallel] modify metainfo input

* [autoparallel] add pooling metainfo

* [autoparallel] add F.linear metainfo generator

* [autoparallel] add binary elementwise metainfo

* [fx] recover profiler

* [autoparallel] fix forward memory calculation

* [autoparallel] modify constants.py

* [autoparallel] remove redundant print

* [autoparallel] add F.conv metainfo

* [autoparallel] linear fix

* [autoparallel] memory estimation for communication actions

* [autoparallel] fix docstring

* [autoparallel] fix variables name
2022-12-21 10:39:37 +08:00
..
deprecated [NFC] polish colossalai/auto_parallel/tensor_shard/deprecated/op_handler/operator_handler.py code style (#1845) 2022-11-09 12:08:47 +08:00
node_handler [autoparallel] use metainfo in handler (#2149) 2022-12-20 10:31:22 +08:00
solver [autoparallel] gpt2lp runtimee test (#2113) 2022-12-12 18:06:40 +08:00
utils [autoparallel] adapt solver with self attention (#2037) 2022-12-01 17:53:15 +08:00
__init__.py [autoparallel] init new folder structure (#1696) 2022-10-13 14:18:55 +08:00
constants.py [autoparallel] adapt solver with self attention (#2037) 2022-12-01 17:53:15 +08:00
sharding_strategy.py [autoparallel] memory estimation for shape consistency (#2144) 2022-12-21 10:39:37 +08:00