ColossalAI/colossalai/fx
Super Daniel 0dbd61c29b
[fx] fix test and algorithm bugs in activation checkpointing. (#1451)
* [fx] modify the calculation of node_size in MetaInfoProp for activation checkpointing usages

* [fx] modify the calculation of node_size in MetaInfoProp for activation checkpointing usages

* [fx] modify the calculation of node_size in MetaInfoProp for activation checkpointing usages

* [fx] merge development into main (#1)

* [fx] activation checkpointing using Chen strategies.

* [fx] add test for ckpt_solver_chen

* [fx] add vanilla activation checkpoint search with test on resnet and densenet

* [fx] add a namespace code for solver_chen.

* [fx] fix the false interpretation of algorithm 3 in https://arxiv.org/abs/1604.06174.

* [fx] fix lowercase naming conventions.

* [fx] simplify test for ckpt.

* [fx] fix test and algorithm bugs in activation checkpointing.

* mend

[fx] fix test and algorithm bugs in activation checkpointing.

* mend

[fx] fix test and algorithm bugs in activation checkpointing.

* mend

[fx] fix test and algorithm bugs in activation checkpointing.

* mend

[fx] fix test and algorithm bugs in activation checkpointing.

* [fx] polish ckpt_test.

* [fx] polish ckpt_test.

* [fx] polish ckpt_test.
2022-08-15 19:09:19 +08:00
..
codegen [NFC] global vars should be upper case (#1456) 2022-08-15 09:50:29 +08:00
passes [fx] fix test and algorithm bugs in activation checkpointing. (#1451) 2022-08-15 19:09:19 +08:00
tracer [fx] patched torch.max and data movement operator (#1391) 2022-08-01 15:31:50 +08:00
__init__.py [fx] supported data-dependent control flow in model tracing (#1185) 2022-06-29 15:05:25 +08:00
proxy.py [doc] update rst and docstring (#1351) 2022-07-21 15:54:53 +08:00