ColossalAI/colossalai/fx
Super Daniel 5c494d4540
[fx] provide an accurate estimation of memory. (#1587)
* [fx] add some comment and docstrings.

* [fx] add dataflow analysis for an autograd graph.

* add intepretation for graph analysis.

* [fx] before doing save_tensor_hooks.

* [fx] provide an accurate estimation of memory except for GPT-2.

* [fx] provide an accurate estimation of memory except for GPT-2.

* [fx] provide an accurate estimation of memory except for GPT-2.

* [fx] a very accurate version on GPT-2.

* [fx] refactor code.

* [fx] remove redundant inplace=True.

* [fx] refactor code.

* [fx] refactor code.

* [fx] refactor code.

* [fx] dive into backward memory.
2022-09-14 09:36:43 +08:00
..
codegen [fx] Add nested checkpoint in activation checkpoint codegen (#1585) 2022-09-12 20:00:48 +08:00
passes [fx] provide an accurate estimation of memory. (#1587) 2022-09-14 09:36:43 +08:00
profiler [fx] provide an accurate estimation of memory. (#1587) 2022-09-14 09:36:43 +08:00
tracer [NFC] polish colossalai/fx/tracer/meta_patch/patched_module/convolution.py code style (#1563) 2022-09-08 22:11:04 +08:00
__init__.py [fx] support meta tracing for aten level computation graphs like functorch. (#1536) 2022-09-05 12:10:09 +08:00
graph_module.py [fx] Fix ckpt functions' definitions in forward (#1476) 2022-08-22 16:59:54 +08:00
proxy.py [hotfix] fix coloproxy typos. (#1519) 2022-08-30 11:39:03 +08:00