You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

LuGY c6ab96983a [zero] refactor low level zero for shard evenly (#4030) ... * refactor low level zero * fix zero2 and support cpu offload * avg gradient and modify unit test * refactor grad store, support layer drop * refactor bucket store, support grad accumulation * fix and update unit test of zero and ddp * compatible with tp, ga and unit test * fix memory leak and polish * add zero layer drop unittest * polish code * fix import err in unit test * support diffenert comm dtype, modify docstring style * polish code * test padding and fix * fix unit test of low level zero * fix pad recording in bucket store * support some models * polish		1 year ago
..
test_dp_plugin_base.py	[CI] fix typo with tests/ etc. (#3727)	2 years ago
test_gemini_plugin.py	[shardformer] adapted T5 and LLaMa test to use kit (#4049)	1 year ago
test_low_level_zero_plugin.py	[zero] refactor low level zero for shard evenly (#4030)	1 year ago
test_torch_ddp_plugin.py	[shardformer] adapted T5 and LLaMa test to use kit (#4049)	1 year ago
test_torch_fsdp_plugin.py	[shardformer] adapted T5 and LLaMa test to use kit (#4049)	1 year ago