4 Commits (853becfb6ef4ad7c7b27b335943c6f06f5b6b51c)

Author	SHA1	Message	Date
ytxiong	853becfb6e	feat(*): support fp32 training (#155) ... * support float32 training * fix lint * add adaptation in model/utils.py * remove some unnecessary code * fix lint * feat(optim): add support for fp32 zero * Revert "Merge pull request #2 from SolenoidWGT/fp32_zero" This reverts commit 53fc50b0e5, reversing changes made to 40f24d0a73. revert commit * merge develop * Update utils.py * support fp32 in zero optimizer * modify the dtype --------- Co-authored-by: wangguoteng.p <wangguoteng925@qq.com>	2023-08-04 16:05:30 +08:00
ytxiong	d67be17f96	refactor(*): refactor the code with no-apex (#170) ... * support no-apex * add default for use_apex * fix lint * modify the RMSNormTorch * remove some comments * remove use_apex parameter * remove some unnecessary code * optimize the code including import * remove the import RMSNorm * remove warnings	2023-08-03 11:24:12 +08:00
ytxiong	1c397f523f	feat(*): support no apex (#166) ... * support no-apex * add default for use_apex * fix lint * modify the RMSNormTorch * remove some comments * remove use_apex parameter * remove some unnecessary code	2023-08-02 20:32:38 +08:00
Sun Peng	fa7337b37b	initial commit	2023-07-06 12:55:23 +08:00