8 Commits (a590ed0ba362eb7c159cc771718b57edfc2107fb)

Author	SHA1	Message	Date
Frank Lee	3601b2bad0	[test] fixed rerun_on_exception and adapted test cases (#487)	2022-03-25 17:25:12 +08:00
ver217	9ec1ce6ab1	[zero] sharded model support the reuse of fp16 shard (#495) ... * sharded model supports reuse fp16 shard * rename variable * polish code * polish code * polish code	2022-03-23 14:59:59 +08:00
ver217	a241f61b34	[zero] Update initialize for ZeRO (#458) ... * polish code * shard strategy receive pg in shard() / gather() * update zero engine * polish code	2022-03-18 16:18:31 +08:00
ver217	642846d6f9	update sharded optim and fix zero init ctx (#457)	2022-03-18 15:44:47 +08:00
Jiarui Fang	e2e9f82588	Revert "[zero] update sharded optim and fix zero init ctx" (#456) ... * Revert "polish code" This reverts commit 8cf7ff08cf. * Revert "rename variables" This reverts commit e99af94ab8. * Revert "remove surplus imports" This reverts commit 46add4a5c5. * Revert "update sharded optim and fix zero init ctx" This reverts commit 57567ee768.	2022-03-18 15:22:43 +08:00
ver217	57567ee768	update sharded optim and fix zero init ctx	2022-03-18 14:25:25 +08:00
Jiarui Fang	0fcfb1e00d	[test] make zero engine test really work (#447)	2022-03-17 17:24:25 +08:00
Jiarui Fang	496cbb0760	[hotfix] fix initialize bug with zero (#442)	2022-03-17 13:16:22 +08:00