InternLM/internlm/solver
ytxiong 853becfb6e
feat(*): support fp32 training (#155)
* support float32 training

* fix lint

* add adaptation in model/utils.py

* remove some unnecessary code

* fix lint

* feat(optim): add support for fp32 zero

* Revert "Merge pull request #2 from SolenoidWGT/fp32_zero"

This reverts commit 53fc50b0e5, reversing
changes made to 40f24d0a73.

revert commit

* merge develop

* Update utils.py

* support fp32 in zero optimizer

* modify the dtype

---------

Co-authored-by: wangguoteng.p <wangguoteng925@qq.com>
2023-08-04 16:05:30 +08:00
..
optimizer feat(*): support fp32 training (#155) 2023-08-04 16:05:30 +08:00
__init__.py initial commit 2023-07-06 12:55:23 +08:00
beta2_scheduler.py initial commit 2023-07-06 12:55:23 +08:00
lr_scheduler.py [Dev] Pull Main (#139) 2023-07-27 10:20:21 +08:00
pipeline_utils.py initial commit 2023-07-06 12:55:23 +08:00