Commit Graph

4 Commits (2e9487096709ba619bec0c2a4961885a24b8c1f3)

Author SHA1 Message Date
huangting4201 2e94870967 fix(internlm/train/training_internlm.py): remove set IS_TENSOR_PARALLEL attr 2023-10-08 20:22:40 +08:00
zaglc 7d52276c13 add support for FSDP with tp 2023-10-08 15:33:31 +08:00
huangting4201 056996f8b3 fix(fsdp_optimizer.py): wait grad async 2023-09-26 16:54:29 +08:00
huangting4201 f3f2511e74 feat(solver/optimizer): add new file fsdp_optimizer.py 2023-09-26 15:46:47 +08:00