Jiarui Fang 920c5889a7 [zero] add colo move inline (#521)		2022-03-25 14:02:55 +08:00
..
init_ctx	[zero] add colo move inline (#521)	2022-03-25 14:02:55 +08:00
shard_utils	[zero] fix init device bug in zero init context unittest (#516)	2022-03-25 12:24:18 +08:00
sharded_model	[zero] show model data cuda memory usage after zero context init. (#515)	2022-03-25 11:23:35 +08:00
sharded_optim	[zero] use colo model data api in optimv2 (#511)	2022-03-24 17:19:34 +08:00
sharded_param	[zero] sharded model support the reuse of fp16 shard (#495)	2022-03-23 14:59:59 +08:00
__init__.py	[zero] Update initialize for ZeRO (#458)	2022-03-18 16:18:31 +08:00