Commit Graph

4 Commits (5bca32e4dc424a69b3ad62bad86cdac3e66c1cae)

Author SHA1 Message Date
huangting4201 2e94870967 fix(internlm/train/training_internlm.py): remove set IS_TENSOR_PARALLEL attr 2023-10-08 20:22:40 +08:00
zaglc 7d52276c13 add support for FSDP with tp 2023-10-08 15:33:31 +08:00
huangting4201 056996f8b3 fix(fsdp_optimizer.py): wait grad async 2023-09-26 16:54:29 +08:00
huangting4201 f3f2511e74 feat(solver/optimizer): add new file fsdp_optimizer.py 2023-09-26 15:46:47 +08:00