ColossalAI/colossalai/fx/profiler
Super Daniel 5c494d4540
[fx] provide an accurate estimation of memory. (#1587)
* [fx] add some comment and docstrings.

* [fx] add dataflow analysis for an autograd graph.

* add intepretation for graph analysis.

* [fx] before doing save_tensor_hooks.

* [fx] provide an accurate estimation of memory except for GPT-2.

* [fx] provide an accurate estimation of memory except for GPT-2.

* [fx] provide an accurate estimation of memory except for GPT-2.

* [fx] a very accurate version on GPT-2.

* [fx] refactor code.

* [fx] remove redundant inplace=True.

* [fx] refactor code.

* [fx] refactor code.

* [fx] refactor code.

* [fx] dive into backward memory.
2022-09-14 09:36:43 +08:00
..
experimental [fx] provide an accurate estimation of memory. (#1587) 2022-09-14 09:36:43 +08:00
__init__.py [fx] provide an accurate estimation of memory. (#1587) 2022-09-14 09:36:43 +08:00
dataflow.py [fx] provide an accurate estimation of memory. (#1587) 2022-09-14 09:36:43 +08:00
memory.py [fx] provide an accurate estimation of memory. (#1587) 2022-09-14 09:36:43 +08:00
opcount.py [fx] provide a stable but not accurate enough version of profiler. (#1547) 2022-09-07 11:21:04 +08:00
profiler.py [fx] provide an accurate estimation of memory. (#1587) 2022-09-14 09:36:43 +08:00
tensor.py [fx] provide a stable but not accurate enough version of profiler. (#1547) 2022-09-07 11:21:04 +08:00