Hongxin Liu a2596519fd [zero] support extra dp (#6123) ... * [zero] support extra dp * [zero] update checkpoint * fix bugs * fix bugs		2024-11-12 11:20:46 +08:00
..
test_coll_nd.py	[zero] support extra dp (#6123)	2024-11-12 11:20:46 +08:00
test_grad_acc.py	[FP8] rebase main (#5963)	2024-08-06 16:29:37 +08:00
test_mem_leak.py	[MoE/ZeRO] Moe refactor with zero refactor (#5821)	2024-06-28 14:00:08 +08:00
test_zero1_2.py	[zero] support extra dp (#6123)	2024-11-12 11:20:46 +08:00
test_zero_ckpt.py	[zero] support extra dp (#6123)	2024-11-12 11:20:46 +08:00