InternLM/internlm/model
Season b6d909d43e
docs(*): add documentation and reST files for readthedocs (#272)
* add initial reST files for readthedocs

* fix typos

* docs refine and minor fix

* add references for parallel training section

* fix reST format

* fix reST format

* fix reST format

* add comments for trainer API

* add link to step-by-step quickstart guide

* docs(code-docs/source/parallel.rst): add paper link url

* docs(code-docs/source/parallel.rst): add paper link url

* use MyST to render markdown

* docs(code-docs/source/initialize.rst): update model init

* add requirements for myst-parser

* reuse install and usage markdown

* docs(code-docs/source/index.rst): add example and q&a

* docs(doc/code-docs/*): docs refine

* docs(code-docs/source/parallel.rst): update docs for zero config

* docs(code-docs/source/example.rst): fix typos for example.rst

* docs(code-docs/source/example.rst): refine docs

* docs(code-docs/source/example): update example

* docs(code-docs/source/example): delete useless example

* docs(code-docs/source/*): fix image display issue

* docs(code-docs/source/parallel.rst): add docs for communication overlap

* docs(code-docs/source/conf.py): update conf.py

* docs(code-docs/source/example): update example 30B demo

* docs(code-docs/source/parallel.rst): update pipeline parallel

* docs(code-docs/source/parallel.rst): update pipeline parallel

* docs(code-docs/source/parallel.rst): update pipeline parallel

* docs(code-docs/source/parallel.rst): update pipeline parallel

* docs(code-docs/source/parallel.rst): update ZeRO1.5

* docs(code-docs/source/parallel.rst): update ZeRO1.5

* docs(code-docs/source): fix word spelling error

---------

Co-authored-by: huangting4201 <huangting3@sensetime.com>
2023-09-06 15:36:03 +08:00
..
__init__.py Merge develop to main (#233) 2023-08-24 22:03:04 +08:00
embedding.py [fix bug] Fix the error that RotaryEmbedding is converted to a non-fp32 format during training, and add a compatible method for the llama model. (#239) 2023-08-26 17:48:08 +08:00
linear.py Merge develop to main (#233) 2023-08-24 22:03:04 +08:00
loss.py initial commit 2023-07-06 12:55:23 +08:00
metrics.py fix(metric): argument missing in getting loss metrics. (#256) 2023-08-31 17:44:39 +08:00
modeling_internlm.py docs(*): add documentation and reST files for readthedocs (#272) 2023-09-06 15:36:03 +08:00
multi_head_attention.py Merge develop to main (#233) 2023-08-24 22:03:04 +08:00
norm.py Merge develop to main (#233) 2023-08-24 22:03:04 +08:00
utils.py Merge develop to main (#233) 2023-08-24 22:03:04 +08:00