ver217 a241f61b34 [zero] Update initialize for ZeRO (#458) ... * polish code * shard strategy receive pg in shard() / gather() * update zero engine * polish code		2022-03-18 16:18:31 +08:00
..
bookkeeping	Feature/zero (#279)	2022-03-11 15:50:28 +08:00
__init__.py	impl shard optim v2 and add unit test	2022-03-11 15:50:28 +08:00
_utils.py	Feature/zero (#279)	2022-03-11 15:50:28 +08:00
sharded_optim.py	[fp16] refactored fp16 optimizer (#392)	2022-03-15 10:05:38 +08:00
sharded_optim_v2.py	[zero] Update initialize for ZeRO (#458)	2022-03-18 16:18:31 +08:00