2 Commits (cf579ff46dc8d6e4c8f9b311134b693c2aeb0adc)

Author	SHA1	Message	Date
Hongxin Liu	b8e770c832	[test] merge old components to test to model zoo (#4945) ... * [test] add custom models in model zoo * [test] update legacy test * [test] update model zoo * [test] update gemini test * [test] remove components to test	2023-10-20 10:35:08 +08:00
Baizhou Zhang	21ba89cab6	[gemini] support gradient accumulation (#4869) ... * add test * fix no_sync bug in low level zero plugin * fix test * add argument for grad accum * add grad accum in backward hook for gemini * finish implementation, rewrite tests * fix test * skip stuck model in low level zero test * update doc * optimize communication & fix gradient checkpoint * modify doc * cleaning codes * update cpu adam fp16 case	2023-10-17 14:07:21 +08:00