ColossalAI

Commit Graph

Author	SHA1	Message	Date
Super Daniel	c8e9b2ad78	[hotfix/rotor] fix variable names (#1597 ) * [fx] add some comment and docstrings. * [fx] add dataflow analysis for an autograd graph. * add intepretation for graph analysis. * [fx] before doing save_tensor_hooks. * [fx] provide an accurate estimation of memory except for GPT-2. * [fx] provide an accurate estimation of memory except for GPT-2. * [fx] provide an accurate estimation of memory except for GPT-2. * [fx] a very accurate version on GPT-2. * [fx] refactor code. * [fx] remove redundant inplace=True. * [fx] refactor code. * [fx] refactor code. * [fx] refactor code. * [fx] dive into backward memory. * [fx] fix variable names in ckpt_solvers and unskip tests. * [fx] commit my changes. * [fx] restore skips. * [fx] restore skips. * [fx] chaange stage into phase. * [fx] chaange stage into phase. * [fx] chaange stage into phase.	2022-09-14 14:27:04 +08:00
Boyuan Yao	49ccf8b5f8	[fx] Improve linearize and rotor solver (#1586 ) * [fx] add nested activation_checkpoint codegen * undo algorithms commits * solver * undo some commits * [fx] torch11 add nested activation checkpoint codegen * remove some imports * [fx] add some comments in activation codegen * [fx] codegen instance error fix * [fx] imporve linearize and rotor solver * [fx] some comments and format modification	2022-09-13 14:50:04 +08:00
Boyuan Yao	46c6cc79a9	[fx] Add common node in model linearize (#1542 ) * [fx] Add common node into linearize * [fx] Add common node to solver	2022-09-05 18:35:05 +08:00
Boyuan Yao	56159049e8	[fx] Modify solver linearize and add corresponding test (#1531 ) * [fx] modify solver linearize and add test * [fx] add torch11 test of linearize but skip it * [fx] remove some unused imports	2022-09-02 10:24:41 +08:00
Boyuan Yao	b231430bcb	[fx] Fix wrong index in annotation and minimal flops in ckpt solver (#1521 ) * [fx] fix wrong variable name in solver rotor * [fx] fix wrong variable name in solver rotor * [fx] fix the discretize bug * [fx] fix the first op in activation checkpoint codegen * [fx] fix some bugs of ckpt solver * [fx] modify test_ckpt_torchvision * [fx] set sequence to __sequence__ attr of GraphModule * [fx] docstring modification * [fx] remove performance test	2022-08-31 18:10:48 +08:00
Boyuan Yao	ac3a453a50	[fx] fix the discretize bug (#1506 ) * [fx] fix wrong variable name in solver rotor * [fx] fix wrong variable name in solver rotor * code modification * [fx] fix the discretize bug	2022-08-26 17:15:52 +08:00
Boyuan Yao	31fffd3fc5	[fx] fix wrong variable name in solver rotor (#1502 ) * [fx] fix wrong variable name in solver rotor * [fx] fix wrong variable name in solver rotor * code modification	2022-08-26 15:47:08 +08:00
Boyuan Yao	de1e716dc4	[fx] Add activation checkpoint solver rotor (#1496 ) * [fx] fix defining ckpt functions inside forward * [fx] Modify activation checkpoint codegen and add ColoGraphModule * [fx] some modification * some modifications * some modifications * some modifications * some modifications * some code modifications * [automatic_parallel] ckpt solver rotor * [fx] add ckpt_solver_rotor * [fx] modification * code refactor * code refactor	2022-08-26 10:34:21 +08:00

8 Commits (a7cda6f57dd8f7fc0d5c7ae3b4b5cf9cd8140c13)