Commit Graph

3 Commits (8a63cb51ef6bc5889ae6d204817e327d79f87255)

Author SHA1 Message Date
Wenwen Qu 8a595837fc merge upstream/develop into feature_add_moe 2023-09-11 16:20:08 +08:00
Sun Peng 32664328e7
Feat/overlap_bcast_forward (#218)
* feat/support bcast forward overlao

* feat/optimize the bcast call

* feat/optimize the bcast call

* feat/optimize the bcast call

* fix lint

* fix lint

* fix lint

* fix lint

* add torch.cuda.synchronize in save_checkpoint

---------

Co-authored-by: sunpeng <sunpengsdu@gmail.com>
2023-08-23 16:59:59 +08:00
Sun Peng fa7337b37b initial commit 2023-07-06 12:55:23 +08:00