3 Commits (2c5395fdfd5106f353a3894820b75ec3cd1dc43a)

Author	SHA1	Message	Date
Wenwen Qu	2c5395fdfd	Doc(moe): add documentation for moe training (#411) ... * add doc for moe * fix moe and zero1 check in args_sanity_check * restore moe config file	2023-10-19 10:01:12 +08:00
ytxiong	e34e7307c9	docs(doc): add tf32 docs (#374) ... * add zh docs for tf32 * add english docs * add docs for tf32 in mix precision * add english doc * modify the gitignore	2023-09-27 15:55:44 +08:00
Wenwen Qu	655e9dae40	Feat(norm)/support fused precision (#319) ... * add fused precision support for norm * refactor code * refactor code * change the granularity of hook * fix bugs if self.model is ModuleList * add dtype condition for post hook * refactor code for split group * refactor code for pre/post hook * refactor code for split group * remove fp32 hook for norm * unit tests for fused precision * add doc for fused precision * add doc for En. version * reformat docs * Update mixed_precision.rst * Update mixed_precision.po * update mixed_precision.po	2023-09-26 20:39:55 +08:00