ColossalAI/colossalai/fx
Super Daniel d40a9392ba
[fx] fix the false interpretation of algorithm 3 in https://arxiv.org/abs/1604.06174. (#1446)
* [fx] modify the calculation of node_size in MetaInfoProp for activation checkpointing usages

* [fx] modify the calculation of node_size in MetaInfoProp for activation checkpointing usages

* [fx] modify the calculation of node_size in MetaInfoProp for activation checkpointing usages

* [fx] activation checkpointing using Chen strategies.

* [fx] add test for ckpt_solver_chen

* mend

* [fx] add vanilla activation checkpoint search with test on resnet and densenet

* [fx] add vanilla activation checkpoint search with test on resnet and densenet

* [fx] add a namespace code for solver_chen.

* [fx] fix the false interpretation of algorithm 3 in https://arxiv.org/abs/1604.06174.

* [fx] fix lowercase naming conventions.
2022-08-12 11:28:50 +08:00
..
codegen [fx] fixed indentation error in checkpointing codegen (#1385) 2022-07-30 00:27:12 +08:00
passes [fx] fix the false interpretation of algorithm 3 in https://arxiv.org/abs/1604.06174. (#1446) 2022-08-12 11:28:50 +08:00
tracer [fx] patched torch.max and data movement operator (#1391) 2022-08-01 15:31:50 +08:00
__init__.py [fx] supported data-dependent control flow in model tracing (#1185) 2022-06-29 15:05:25 +08:00
proxy.py [doc] update rst and docstring (#1351) 2022-07-21 15:54:53 +08:00