5 Commits (edd7f9e8e1958f7a7dcd2fbf3a71ac93616699db)

Author	SHA1	Message	Date
huangting4201	edd7f9e8e1	feat(configs/7B_sft.py): move fsdp config to parallel zero1	2023-10-09 17:39:52 +08:00
huangting4201	2e94870967	fix(internlm/train/training_internlm.py): remove set IS_TENSOR_PARALLEL attr	2023-10-08 20:22:40 +08:00
zaglc	7d52276c13	add support for FSDP with tp	2023-10-08 15:33:31 +08:00
huangting4201	056996f8b3	fix(fsdp_optimizer.py): wait grad async	2023-09-26 16:54:29 +08:00
huangting4201	f3f2511e74	feat(solver/optimizer): add new file fsdp_optimizer.py	2023-09-26 15:46:47 +08:00