ColossalAI/colossalai/fx/passes
Super Daniel 5c494d4540
[fx] provide an accurate estimation of memory. (#1587)
* [fx] add some comment and docstrings.

* [fx] add dataflow analysis for an autograd graph.

* add intepretation for graph analysis.

* [fx] before doing save_tensor_hooks.

* [fx] provide an accurate estimation of memory except for GPT-2.

* [fx] provide an accurate estimation of memory except for GPT-2.

* [fx] provide an accurate estimation of memory except for GPT-2.

* [fx] a very accurate version on GPT-2.

* [fx] refactor code.

* [fx] remove redundant inplace=True.

* [fx] refactor code.

* [fx] refactor code.

* [fx] refactor code.

* [fx] dive into backward memory.
2022-09-14 09:36:43 +08:00
..
algorithms [fx] Improve linearize and rotor solver (#1586) 2022-09-13 14:50:04 +08:00
__init__.py [fx]add autoparallel passes (#1121) 2022-06-15 16:36:46 +08:00
adding_split_node_pass.py [fx] update split module pass and add customized policy (#1373) 2022-07-27 13:40:54 +08:00
meta_info_prop.py [fx] provide an accurate estimation of memory. (#1587) 2022-09-14 09:36:43 +08:00
passes_for_gpt2_test.py [hotfix] fix some bugs during gpt2 testing (#1379) 2022-07-28 17:21:07 +08:00
shard_1d_pass.py [Doc] add more doc for ColoTensor. (#1458) 2022-08-16 10:38:41 +08:00
split_module.py [fx] fixed compatiblity issue with torch 1.10 (#1331) 2022-07-18 11:41:27 +08:00
utils.py [autoparallel] added liveness analysis (#1516) 2022-08-30 15:54:37 +08:00