Super Daniel 32efe8e740 [fx] add profiler for fx nodes. (#1480) ... * [fx] modify the calculation of node_size in MetaInfoProp for activation checkpointing usages * [fx] modify the calculation of node_size in MetaInfoProp for activation checkpointing usages * [fx] modify the calculation of node_size in MetaInfoProp for activation checkpointing usages * [fx] merge development into main (#1) * [fx] activation checkpointing using Chen strategies. * [fx] add test for ckpt_solver_chen * [fx] add vanilla activation checkpoint search with test on resnet and densenet * [fx] add a namespace code for solver_chen. * [fx] fix the false interpretation of algorithm 3 in https://arxiv.org/abs/1604.06174. * [fx] fix lowercase naming conventions. * [fx] simplify test for ckpt. * [fx] add rules to linearize computation graphs for searching. (#2) * [fx] modify the calculation of node_size in MetaInfoProp for activation checkpointing usages * [fx] modify the calculation of node_size in MetaInfoProp for activation checkpointing usages * [fx] modify the calculation of node_size in MetaInfoProp for activation checkpointing usages * [fx] merge development into main (#1) * [fx] activation checkpointing using Chen strategies. * [fx] add test for ckpt_solver_chen * [fx] add vanilla activation checkpoint search with test on resnet and densenet * [fx] add a namespace code for solver_chen. * [fx] fix the false interpretation of algorithm 3 in https://arxiv.org/abs/1604.06174. * [fx] fix lowercase naming conventions. * [fx] simplify test for ckpt. * [fx] fix test and algorithm bugs in activation checkpointing. * [fx] polish ckpt_test. * [fx] add rules to linearize computation graphs for searching. * [fx] remove chen_sqrt for sake of simplicity * [fx] remove chen_sqrt for sake of simplicity * [fx] remove chen_sqrt for sake of simplicity * [fx] remove chen_sqrt for sake of simplicity * [fx] fix inconsistencies. * [fx] fix MetaInfoProp. * [fx] fix MetaInfoProp. * [fx] consider MetaInfoProp for inplace operands. * [fx] consider MetaInfoProp for inplace operands. * [fx] consider MetaInfoProp for inplace operands. * [fx] consider MetaInfoProp for inplace operands. * [fx] consider MetaInfoProp for inplace operands. * [fx] add profiler for fx nodes. * [fx] add profiler for fx nodes. * [fx] add profiler for fx nodes. * [fx] add profiler for fx nodes. * [fx] add profiler for fx nodes. * [fx] add profiler for fx nodes. * [fx] add profiler for fx nodes. * [fx] fix error in tests. * [fx] unfix bug. * [fx] unfix bug.		2022-08-24 16:22:44 +08:00
..
test_ckpt_solvers	[fx] add profiler for fx nodes. (#1480)	2022-08-24 16:22:44 +08:00
test_codegen	[fx] Fix ckpt functions' definitions in forward (#1476)	2022-08-22 16:59:54 +08:00
test_pipeline	[fx] refactor tracer to trace complete graph (#1342)	2022-07-20 11:20:38 +08:00
test_tracer	[fx] fixed torchaudio conformer tracing (#1392)	2022-08-01 16:08:28 +08:00
test_coloproxy.py	[fx] refactor tracer to trace complete graph (#1342)	2022-07-20 11:20:38 +08:00
test_comm_size_compute.py	[fx] add profiler for fx nodes. (#1480)	2022-08-24 16:22:44 +08:00
test_complete_workflow.py	[fx] tested the complete workflow for auto-parallel (#1336)	2022-07-20 10:45:17 +08:00
test_graph_manipulation.py	[fx] methods to get fx graph property. (#1246)	2022-07-12 14:10:37 +08:00
test_meta_info_prop.py	[fx] add profiler for fx nodes. (#1480)	2022-08-24 16:22:44 +08:00
test_parallel_1d.py	[fx]add autoparallel passes (#1121)	2022-06-15 16:36:46 +08:00
test_pipeline_passes.py	[fx] recovered skipped pipeline tests (#1338)	2022-07-19 09:49:50 +08:00