ColossalAI

Author	SHA1	Message	Date
Jiarui Fang	d1211148a7	[utils] update colo tensor moving APIs (#553 )	2022-03-30 23:13:24 +08:00
Jiarui Fang	53b1b6e340	[zero] non model data tracing (#545 )	2022-03-29 15:45:48 +08:00
Jiarui Fang	c11ff81b15	[zero] get memory usage of sharded optim v2. (#542 )	2022-03-29 09:08:18 +08:00
Jiarui Fang	705f56107c	[zero] refactor model data tracing (#537 )	2022-03-28 16:38:18 +08:00
Jiarui Fang	05e33b2578	[zero] fix grad offload (#528 ) * [zero] fix grad offload * polish code	2022-03-25 18:23:25 +08:00
Jiarui Fang	8d8c5407c0	[zero] refactor model data tracing (#522 )	2022-03-25 18:03:32 +08:00
Jiarui Fang	920c5889a7	[zero] add colo move inline (#521 )	2022-03-25 14:02:55 +08:00
Jiarui Fang	0bebda6ea5	[zero] fix init device bug in zero init context unittest (#516 )	2022-03-25 12:24:18 +08:00
Jiarui Fang	9330be0f3c	[memory] set cuda mem frac (#506 )	2022-03-24 16:57:13 +08:00
Jiarui Fang	0035b7be07	[memory] add model data tensor moving api (#503 )	2022-03-24 14:29:41 +08:00