InternLM/internlm/train
Wenwen Qu 655e9dae40
Feat(norm)/support fused precision (#319)
* add fused precision support for norm

* refactor code

* refactor code

* change the granularity of hook

* fix bugs if self.model is ModuleList

* add dtype condition for post hook

* refactor code for split group

* refactor code for pre/post hook

* refactor code for split group

* remove fp32 hook for norm

* unit tests for fused precision

* add doc for fused precision

* add doc for En. version

* reformat docs

* Update mixed_precision.rst

* Update mixed_precision.po

* update mixed_precision.po
2023-09-26 20:39:55 +08:00
..
__init__.py Merge develop to main (#233) 2023-08-24 22:03:04 +08:00
training_internlm.py Feat(norm)/support fused precision (#319) 2023-09-26 20:39:55 +08:00
utils.py Feat(norm)/support fused precision (#319) 2023-09-26 20:39:55 +08:00