Commit Graph

9 Commits (80d4744c424333a8b2a0cf8b4f8b58406586c197)

Author SHA1 Message Date
ytxiong e34e7307c9
docs(doc): add tf32 docs (#374)
* add zh docs for tf32

* add english docs

* add docs for tf32 in mix precision

* add english doc

* modify the gitignore
2023-09-27 15:55:44 +08:00
Season 07038d1224
docs(doc/code-docs): update document image for InternLM parallel architecture (#373)
* docs(doc/imgs): update image for internlm parallel architecture

* docs(doc/code-docs): remove fuzzy translation in sphinx files

* update english translation in readthedocs
2023-09-27 11:50:22 +08:00
Wenwen Qu 655e9dae40
Feat(norm)/support fused precision (#319)
* add fused precision support for norm

* refactor code

* refactor code

* change the granularity of hook

* fix bugs if self.model is ModuleList

* add dtype condition for post hook

* refactor code for split group

* refactor code for pre/post hook

* refactor code for split group

* remove fp32 hook for norm

* unit tests for fused precision

* add doc for fused precision

* add doc for En. version

* reformat docs

* Update mixed_precision.rst

* Update mixed_precision.po

* update mixed_precision.po
2023-09-26 20:39:55 +08:00
jiaopenglong 9284303a6d
doc(monitor): add light monitoring doc (#352)
* add light monitoring doc

* update light monitoring doc

* update light monitoring doc

* update light monitoring doc

* update light monitoring doc continue

* update light monitoring doc continue

* update monitor config doc

* update monitor config doc continue

* update monitor config doc continue
2023-09-25 19:28:09 +08:00
Guoteng d1e52f0c03
feat(doc/code-docs): add checkpoint save/load usage doc (#311)
* feat(doc): add checkpoint doc

* fix checkpoint doc

* fix comment

* fix(doc/code-docs): remove fuzzy

* fix(doc/code-docs): fix some errors

* fix(doc/code-docs): minor fix

---------

Co-authored-by: li126com <li126com2@126.com>
Co-authored-by: huangting4201 <1538303371@qq.com>
2023-09-22 18:45:33 +08:00
huangting4201 607f691e16
Merge main to develop (#312)
* fix(chat): fix stream_chat to return generator (#123)

* fix(configs/7B_sft.py): model dtype float16 to bfloat16 (#302)

* fix(convert2hf.py): fix the rotary_emb.inv_freq KeyError (#299)

* docs(doc/code-docs): update quickstart usage (#301)

* docs(usage.md): update usage.md

* docs(doc/code-docs): update en usage

---------

Co-authored-by: huangting4201 <huangting3@sensetime.com>

* docs(doc/code-docs): update en usage

---------

Co-authored-by: yingtongxiong <974106207@qq.com>
Co-authored-by: zhjunqin <zhjunqin@users.noreply.github.com>
Co-authored-by: jiangtann <39088437+jiangtann@users.noreply.github.com>
Co-authored-by: huangting4201 <huangting3@sensetime.com>
2023-09-15 16:19:26 +08:00
Season de68cc5007
docs(doc/code-docs): add figure for training docs (#307)
* add training image for docs

* docs(doc/code-docs): add training img for en doc

* docs(doc/code-docs): fix en docs for initialize

* docs(doc/code-docs): update conf file for readthedocs

* docs(doc/code-docs): fix typos

* docs(doc/code-docs): fix typos for reathedocs

* docs(doc/code-docs): minor typo fix for reathedocs

* docs(doc/code-docs): fix readthedocs conf file

* docs(doc/code-docs): update training image

* docs(doc/code-docs): fix typos

* docs(doc/code-docs): update training image

* docs(doc/code-docs): move training image to section initialize

* docs(doc/code-docs): fix lint

* add badge about reathedocs status
2023-09-15 15:22:22 +08:00
Season 06807a6fd5
docs(doc/code-docs): refine profiler docs (#295)
* add detailed profiler guide

* added torch profiler detailed docs

* add english docs for profiler page

* docs(code-docs/source/profiler.rst): resize profiler trace image

* docs(code-docs/source/profiler.rst): fix typo

* docs(doc/imgs/torch_profiler_trace.png): update trace image
2023-09-08 16:58:36 +08:00
huangting4201 671c752de6
docs(doc/code-docs): support zh cn readthedocs (#289)
* feat(code-docs): test auto doc

* feat(code-docs): test auto doc

* feat(code-docs): test auto doc

* feat(code-docs): test auto doc

* docs(doc/code-docs): add zh_CN structure

* docs(doc/code-docs): test install.md

* docs(doc/code-docs): source file to zh

* docs(doc/code-docs): update source files

* docs(doc/code-docs): add locales en

* docs(doc/code-docs): add locales en install

* docs(doc/code-docs): add locales en example

* docs(doc/code-docs): update en checkpoint

* add en translation for parallel.rst docs

* add en translation for profiler.po docs

* docs(doc/code-docs): update en monitor

* add en translation for monuitor, qa, training docs

* add en translation for quickstart docs

* docs(doc/code-docs): update monitor.po and usage.po

* docs(doc/code-docs): fix typos

* docs(doc/code-docs): update en parallel

* docs(doc/code-docs): update en parallel

* docs(doc/code-docs): update en usage

* docs(doc/code-docs): update en profilier

* docs(doc/code-docs): update en initialize

* docs(doc/code-docs): update en initialize

* docs(doc/code-docs): update en initialize

* docs(doc/code-docs): update en initialize

---------

Co-authored-by: zigzagcai <caizheng@pjlab.org.cn>
2023-09-07 16:11:08 +08:00