Commit Graph

10 Commits (f5caa1c048801ba948dd0344dfb554220951cb1b)

Author SHA1 Message Date
Wenwen Qu f96764868d change condition for compatibility 2023-09-27 12:36:03 +08:00
Wenwen Qu 2a70262ceb fix merge bugs 2023-09-27 11:17:03 +08:00
Wenwen Qu 54af6ba297 merge develop into feature_add_moe 2023-09-26 21:00:22 +08:00
Wenwen Qu 655e9dae40
Feat(norm)/support fused precision (#319)
* add fused precision support for norm

* refactor code

* refactor code

* change the granularity of hook

* fix bugs if self.model is ModuleList

* add dtype condition for post hook

* refactor code for split group

* refactor code for pre/post hook

* refactor code for split group

* remove fp32 hook for norm

* unit tests for fused precision

* add doc for fused precision

* add doc for En. version

* reformat docs

* Update mixed_precision.rst

* Update mixed_precision.po

* update mixed_precision.po
2023-09-26 20:39:55 +08:00
Wenwen Qu f6cadcafa2 fix bugs with split group 2023-09-22 16:05:21 +08:00
Wenwen Qu a5e80bcc56 refactor code for split param group 2023-09-22 15:24:28 +08:00
Wenwen Qu 3607548265 refactor code for split group 2023-09-22 13:00:26 +08:00
Qu Wenwen 17bc5f562b refactor code 2023-09-21 15:00:28 +08:00
Qu Wenwen 9665321745 refactor code 2023-09-21 11:51:17 +08:00
Qu Wenwen 4a47872382 refactor code 2023-09-19 12:30:40 +08:00