ver217 a241f61b34 [zero] Update initialize for ZeRO (#458) ... * polish code * shard strategy receive pg in shard() / gather() * update zero engine * polish code		2022-03-18 16:18:31 +08:00
..
init_ctx	update sharded optim and fix zero init ctx (#457)	2022-03-18 15:44:47 +08:00
shard_utils	[zero] Update initialize for ZeRO (#458)	2022-03-18 16:18:31 +08:00
sharded_model	[zero] Update initialize for ZeRO (#458)	2022-03-18 16:18:31 +08:00
sharded_optim	[zero] Update initialize for ZeRO (#458)	2022-03-18 16:18:31 +08:00
sharded_param	use double buffer to handle grad	2022-03-16 14:24:09 +08:00
__init__.py	[zero] Update initialize for ZeRO (#458)	2022-03-18 16:18:31 +08:00