InternLM/internlm
Wenwen Qu 655e9dae40
Feat(norm)/support fused precision (#319)
* add fused precision support for norm

* refactor code

* refactor code

* change the granularity of hook

* fix bugs if self.model is ModuleList

* add dtype condition for post hook

* refactor code for split group

* refactor code for pre/post hook

* refactor code for split group

* remove fp32 hook for norm

* unit tests for fused precision

* add doc for fused precision

* add doc for En. version

* reformat docs

* Update mixed_precision.rst

* Update mixed_precision.po

* update mixed_precision.po
2023-09-26 20:39:55 +08:00
..
apis initial commit 2023-07-06 12:55:23 +08:00
core Feat(norm)/support fused precision (#319) 2023-09-26 20:39:55 +08:00
data Merge develop to main (#233) 2023-08-24 22:03:04 +08:00
initialize feat(numa): bind numa if possible (#320) 2023-09-25 19:34:52 +08:00
model fix(model/embedding.py): ci lint check error (#345) 2023-09-21 14:46:22 +08:00
monitor doc(monitor): add light monitoring doc (#352) 2023-09-25 19:28:09 +08:00
solver feat: add runtime diag (#297) 2023-09-08 17:56:46 +08:00
train Feat(norm)/support fused precision (#319) 2023-09-26 20:39:55 +08:00
utils fix(storage): fix try_get_storage_backend (#359) 2023-09-25 15:16:25 +08:00
__init__.py initial commit 2023-07-06 12:55:23 +08:00