mirror of https://github.com/hpcaitech/ColossalAI
5c494d4540
* [fx] add some comment and docstrings. * [fx] add dataflow analysis for an autograd graph. * add intepretation for graph analysis. * [fx] before doing save_tensor_hooks. * [fx] provide an accurate estimation of memory except for GPT-2. * [fx] provide an accurate estimation of memory except for GPT-2. * [fx] provide an accurate estimation of memory except for GPT-2. * [fx] a very accurate version on GPT-2. * [fx] refactor code. * [fx] remove redundant inplace=True. * [fx] refactor code. * [fx] refactor code. * [fx] refactor code. * [fx] dive into backward memory. |
||
---|---|---|
.. | ||
algorithms | ||
__init__.py | ||
adding_split_node_pass.py | ||
meta_info_prop.py | ||
passes_for_gpt2_test.py | ||
shard_1d_pass.py | ||
split_module.py | ||
utils.py |