InternLM/internlm/solver/optimizer
Sun Peng 32664328e7
Feat/overlap_bcast_forward (#218)
* feat/support bcast forward overlao

* feat/optimize the bcast call

* feat/optimize the bcast call

* feat/optimize the bcast call

* fix lint

* fix lint

* fix lint

* fix lint

* add torch.cuda.synchronize in save_checkpoint

---------

Co-authored-by: sunpeng <sunpengsdu@gmail.com>
2023-08-23 16:59:59 +08:00
..
__init__.py initial commit 2023-07-06 12:55:23 +08:00
hybrid_zero_optim.py Feat/overlap_bcast_forward (#218) 2023-08-23 16:59:59 +08:00
store.py fix(ci): fix ci train error (#199) 2023-08-15 20:09:54 +08:00
utils.py Feat/overlap_bcast_forward (#218) 2023-08-23 16:59:59 +08:00