Commit Graph

6 Commits (f3f2511e74d7fe0271fbf450ae85579acdde05b8)

Author SHA1 Message Date
huangting4201 f3f2511e74 feat(solver/optimizer): add new file fsdp_optimizer.py 2023-09-26 15:46:47 +08:00
zaglc 9b1b0c5c20 fix format problem 2023-09-14 17:03:36 +08:00
zaglc aedd88e5a7 fix(fsdp): fix conflicts 2023-09-08 16:31:38 +08:00
Guoteng f6e007f95b
feat(ckpt): fix checkpoint bugs and add feature enhancements. (#259)
* fix(ckpt): ckpt bug fix and api refactor
1. fix latest ckpt query bug
2. add ckpt unit test
3. fix storage manager boto3/local client get_fns bug
4. fix only model load case zero fp32 buffer overwrite model weights bug.
5. add ckpt_type and add zero reload ci-test

* fix(ckpt): fix ckpt and trainer bug

* fix and refactor

* fix base on comment

* feat: add legacy api
2023-09-05 17:40:48 +08:00
zaglc 85c6ed6473 feat(fsdp): add training option for fsdp 2023-09-04 18:01:30 +08:00
Sun Peng fa7337b37b initial commit 2023-07-06 12:55:23 +08:00