ColossalAI

Author	SHA1	Message	Date
Jiarui Fang	e956d93ac2	[refactor] memory utils (#577 )	2022-04-01 09:22:33 +08:00
ver217	7c6c427db1	[zero] trace states of fp16/32 grad and fp32 param (#571 )	2022-03-31 16:26:54 +08:00
Jiarui Fang	d1211148a7	[utils] update colo tensor moving APIs (#553 )	2022-03-30 23:13:24 +08:00
Liang Bowen	ec5086c49c	Refactored docstring to google style	2022-03-29 17:17:47 +08:00
Jiarui Fang	53b1b6e340	[zero] non model data tracing (#545 )	2022-03-29 15:45:48 +08:00
Jiarui Fang	c11ff81b15	[zero] get memory usage of sharded optim v2. (#542 )	2022-03-29 09:08:18 +08:00
Jiarui Fang	705f56107c	[zero] refactor model data tracing (#537 )	2022-03-28 16:38:18 +08:00
Jiarui Fang	05e33b2578	[zero] fix grad offload (#528 ) * [zero] fix grad offload * polish code	2022-03-25 18:23:25 +08:00
Jiarui Fang	8d8c5407c0	[zero] refactor model data tracing (#522 )	2022-03-25 18:03:32 +08:00
Jiarui Fang	920c5889a7	[zero] add colo move inline (#521 )	2022-03-25 14:02:55 +08:00
Jiarui Fang	0bebda6ea5	[zero] fix init device bug in zero init context unittest (#516 )	2022-03-25 12:24:18 +08:00
Jiarui Fang	9330be0f3c	[memory] set cuda mem frac (#506 )	2022-03-24 16:57:13 +08:00
Jiarui Fang	0035b7be07	[memory] add model data tensor moving api (#503 )	2022-03-24 14:29:41 +08:00