ColossalAI/colossalai
Boyuan Yao 7c7921f71b
[autoparallel] add torch.nn.ReLU metainfo (#1868)
* [fx] metainfo class for auto parallel

* [fx] add unit test for linear metainfo

* [fx] fix bwd param for linear

* [fx] modify unit test

* [fx] modify unit test

* [fx] modify import

* [fx] modify import

* [fx] modify import

* [fx] move meta profiler to auto parallel

* [fx] add conv metainfo class

* [fx] restore profiler

* [fx] restore meta profiler

* [autoparallel] modify unit test

* [fx] modify unit test

* [autoparallel] add batchnorm metainfo class

* [autoparallel] fix batchnorm unit test function declaration

* [fx] restore profiler

* [fx] add relu metainfo class

* [fx] restore profiler

* [autoparallel] modify metainfo input
2022-11-16 23:12:31 +08:00
..
amp [NFC] polish colossalai/amp/naive_amp/__init__.py code style (#1905) 2022-11-11 17:49:18 +08:00
auto_parallel [autoparallel] add torch.nn.ReLU metainfo (#1868) 2022-11-16 23:12:31 +08:00
builder
cli
communication
context updated tp layers 2022-11-02 12:19:38 +08:00
device [autoparallel] add numerical test for node strategies (#1760) 2022-10-27 10:42:54 +08:00
engine
fx [autoparallel] support addmm in tracer and solver (#1961) 2022-11-16 14:59:18 +08:00
gemini [Gemini] polish memstats collector (#1962) 2022-11-16 15:45:57 +08:00
kernel updated flash attention api 2022-11-15 15:25:39 +08:00
logging fixed logger 2022-11-15 16:00:07 +08:00
nn [Gemini] add GeminiAdamOptimizer (#1960) 2022-11-16 14:44:28 +08:00
pipeline [Pipeline]Adapt to Pipelinable OPT (#1782) 2022-11-01 14:18:50 +08:00
registry
tensor [autoparallel] remove redundancy comm node (#1893) 2022-11-15 10:53:41 +08:00
testing
trainer [polish] remove useless file _mem_tracer_hook.py (#1963) 2022-11-16 15:55:10 +08:00
utils [ColoTensor] reconfig ColoInitContext, decouple default_pg and default_dist_spec. (#1953) 2022-11-15 16:24:16 +08:00
zero [Gemini] polish memstats collector (#1962) 2022-11-16 15:45:57 +08:00
__init__.py version to 0.1.11rc2 (#1832) 2022-11-08 17:25:15 +08:00
constants.py updated tp layers 2022-11-02 12:19:38 +08:00
core.py
global_variables.py updated tp layers 2022-11-02 12:19:38 +08:00
initialize.py