ColossalAI/colossalai/fx/passes
Super Daniel 5c494d4540
[fx] provide an accurate estimation of memory. (#1587)
* [fx] add some comment and docstrings.

* [fx] add dataflow analysis for an autograd graph.

* add intepretation for graph analysis.

* [fx] before doing save_tensor_hooks.

* [fx] provide an accurate estimation of memory except for GPT-2.

* [fx] provide an accurate estimation of memory except for GPT-2.

* [fx] provide an accurate estimation of memory except for GPT-2.

* [fx] a very accurate version on GPT-2.

* [fx] refactor code.

* [fx] remove redundant inplace=True.

* [fx] refactor code.

* [fx] refactor code.

* [fx] refactor code.

* [fx] dive into backward memory.
2022-09-14 09:36:43 +08:00
..
algorithms [fx] Improve linearize and rotor solver (#1586) 2022-09-13 14:50:04 +08:00
__init__.py
adding_split_node_pass.py
meta_info_prop.py [fx] provide an accurate estimation of memory. (#1587) 2022-09-14 09:36:43 +08:00
passes_for_gpt2_test.py
shard_1d_pass.py [Doc] add more doc for ColoTensor. (#1458) 2022-08-16 10:38:41 +08:00
split_module.py
utils.py [autoparallel] added liveness analysis (#1516) 2022-08-30 15:54:37 +08:00