Commit Graph

4 Commits (bd809a61f21cf468f7c436b58f36b49d06ff4984)

Author SHA1 Message Date
huangting4201 2e94870967 fix(internlm/train/training_internlm.py): remove set IS_TENSOR_PARALLEL attr 2023-10-08 20:22:40 +08:00
zaglc 7d52276c13 add support for FSDP with tp 2023-10-08 15:33:31 +08:00
huangting4201 056996f8b3 fix(fsdp_optimizer.py): wait grad async 2023-09-26 16:54:29 +08:00
huangting4201 f3f2511e74 feat(solver/optimizer): add new file fsdp_optimizer.py 2023-09-26 15:46:47 +08:00