mirror of https://github.com/hpcaitech/ColossalAI
d40a9392ba
* [fx] modify the calculation of node_size in MetaInfoProp for activation checkpointing usages * [fx] modify the calculation of node_size in MetaInfoProp for activation checkpointing usages * [fx] modify the calculation of node_size in MetaInfoProp for activation checkpointing usages * [fx] activation checkpointing using Chen strategies. * [fx] add test for ckpt_solver_chen * mend * [fx] add vanilla activation checkpoint search with test on resnet and densenet * [fx] add vanilla activation checkpoint search with test on resnet and densenet * [fx] add a namespace code for solver_chen. * [fx] fix the false interpretation of algorithm 3 in https://arxiv.org/abs/1604.06174. * [fx] fix lowercase naming conventions. |
||
|---|---|---|
| .. | ||
| components_to_test | ||
| test_amp | ||
| test_comm | ||
| test_config | ||
| test_context | ||
| test_data | ||
| test_data_pipeline_tensor_parallel | ||
| test_ddp | ||
| test_device | ||
| test_engine | ||
| test_fx | ||
| test_gemini | ||
| test_layers | ||
| test_moe | ||
| test_ops | ||
| test_optimizer | ||
| test_pipeline | ||
| test_tensor | ||
| test_trainer | ||
| test_utils | ||
| test_zero | ||
| __init__.py | ||