mirror of https://github.com/InternLM/InternLM
![]() * add fused precision support for norm * refactor code * refactor code * change the granularity of hook * fix bugs if self.model is ModuleList * add dtype condition for post hook * refactor code for split group * refactor code for pre/post hook * refactor code for split group * remove fp32 hook for norm * unit tests for fused precision * add doc for fused precision * add doc for En. version * reformat docs * Update mixed_precision.rst * Update mixed_precision.po * update mixed_precision.po |
||
---|---|---|
.. | ||
communication | ||
context | ||
scheduler | ||
__init__.py | ||
engine.py | ||
gradient_handler.py | ||
naive_amp.py | ||
trainer.py |