Commit Graph

8 Commits (96171d5f2816a9e8166fe2a0e4e1a2394881aff7)

Author SHA1 Message Date
zaglc aedd88e5a7 fix(fsdp): fix conflicts 2023-09-08 16:31:38 +08:00
zaglc 1d60f90ed9 fix failure in lint-check 2023-09-08 13:19:42 +08:00
zaglc 31d2a2916d feat(fsdp) add mix-precision 2 2023-09-08 10:16:58 +08:00
Guoteng 37b8c6684e
feat(utils): add timeout warpper for key functions (#286) 2023-09-07 17:26:17 +08:00
Wenwen Qu 7f687bf4b3
fix(core/context): use dummy mode to generate random numbers in model construction (#266)
* change mode to dummy in model construction and restore to data when done

* add comments

* move set_mode(.DATA) to initialize_model(.)
2023-09-06 14:34:11 +08:00
zaglc 85c6ed6473 feat(fsdp): add training option for fsdp 2023-09-04 18:01:30 +08:00
Sun Peng 860de0aa46
Feat/add runntime gpu test (#254)
* feat: add gpu bench

* feat/add allreduce runtime bench

---------

Co-authored-by: sunpengsdu <sunpengsdu@gmail.com>
2023-09-01 13:38:01 +08:00
Sun Peng fa7337b37b initial commit 2023-07-06 12:55:23 +08:00