7 Commits (c1594e4bad5056d5500b7dbf1218241bb7e8eb84)

Author	SHA1	Message	Date
Hongxin Liu	3788fefc7a	[zero] support multiple (partial) backward passes (#5596) ... * [zero] support multiple (partial) backward passes * [misc] update requirements	8 months ago
digger yu	bce9499ed3	fix some typo (#5307)	10 months ago
littsk	11f1e426fe	[hotfix] Correct several erroneous code comments (#4794)	1 year ago
Hongxin Liu	079bf3cb26	[misc] update pre-commit and run all files (#4752) ... * [misc] update pre-commit * [misc] run pre-commit * [misc] remove useless configuration files * [misc] ignore cuda for clang-format	1 year ago
LuGY	d86ddd9b29	[hotfix] fix unsafe async comm in zero (#4404) ... * improve stablility of zero * fix wrong index * add record stream	1 year ago
LuGY	c6ab96983a	[zero] refactor low level zero for shard evenly (#4030) ... * refactor low level zero * fix zero2 and support cpu offload * avg gradient and modify unit test * refactor grad store, support layer drop * refactor bucket store, support grad accumulation * fix and update unit test of zero and ddp * compatible with tp, ga and unit test * fix memory leak and polish * add zero layer drop unittest * polish code * fix import err in unit test * support diffenert comm dtype, modify docstring style * polish code * test padding and fix * fix unit test of low level zero * fix pad recording in bucket store * support some models * polish	1 year ago
ver217	26b7aac0be	[zero] reorganize zero/gemini folder structure (#3424) ... * [zero] refactor low-level zero folder structure * [zero] fix legacy zero import path * [zero] fix legacy zero import path * [zero] remove useless import * [zero] refactor gemini folder structure * [zero] refactor gemini folder structure * [zero] refactor legacy zero import path * [zero] refactor gemini folder structure * [zero] refactor gemini folder structure * [zero] refactor gemini folder structure * [zero] refactor legacy zero import path * [zero] fix test import path * [zero] fix test * [zero] fix circular import * [zero] update import	2 years ago