You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Baizhou Zhang 21ba89cab6 [gemini] support gradient accumulation (#4869) ... * add test * fix no_sync bug in low level zero plugin * fix test * add argument for grad accum * add grad accum in backward hook for gemini * finish implementation, rewrite tests * fix test * skip stuck model in low level zero test * update doc * optimize communication & fix gradient checkpoint * modify doc * cleaning codes * update cpu adam fp16 case		1 year ago
..
gemini	[gemini] support gradient accumulation (#4869)	1 year ago
low_level	[feature] support no master weights option for low level zero plugin (#4816)	1 year ago
__init__.py	[misc] update pre-commit and run all files (#4752)	1 year ago
wrapper.py	[misc] update pre-commit and run all files (#4752)	1 year ago