e34e7307c9
docs(doc): add tf32 docs ( #374 )
...
* add zh docs for tf32
* add english docs
* add docs for tf32 in mix precision
* add english doc
* modify the gitignore
2023-09-27 15:55:44 +08:00
07038d1224
docs(doc/code-docs): update document image for InternLM parallel architecture ( #373 )
...
* docs(doc/imgs): update image for internlm parallel architecture
* docs(doc/code-docs): remove fuzzy translation in sphinx files
* update english translation in readthedocs
2023-09-27 11:50:22 +08:00
a86c4bbbfd
Merge branch 'main' into develop
2023-09-22 19:24:03 +08:00
d1e52f0c03
feat(doc/code-docs): add checkpoint save/load usage doc ( #311 )
...
* feat(doc): add checkpoint doc
* fix checkpoint doc
* fix comment
* fix(doc/code-docs): remove fuzzy
* fix(doc/code-docs): fix some errors
* fix(doc/code-docs): minor fix
---------
Co-authored-by: li126com <li126com2@126.com>
Co-authored-by: huangting4201 <1538303371@qq.com>
2023-09-22 18:45:33 +08:00
2a09ebd5c1
doc(readme): update readme, add 20B releasing info ( #328 )
...
* fix(eval): StreamingDataset does not have an __len__ method.
* doc(readme): update readme
* update readme
2023-09-20 16:04:43 +08:00
2710fa7343
Merge develop to main ( #314 )
...
* feat: add unitest for model (#300 )
* feat: add unitest for model
* feat:add model test
* Merge main to develop (#309 )
* fix(chat): fix stream_chat to return generator (#123 )
* fix(configs/7B_sft.py): model dtype float16 to bfloat16 (#302 )
* fix(convert2hf.py): fix the rotary_emb.inv_freq KeyError (#299 )
---------
Co-authored-by: yingtongxiong <974106207@qq.com>
Co-authored-by: zhjunqin <zhjunqin@users.noreply.github.com>
Co-authored-by: jiangtann <39088437+jiangtann@users.noreply.github.com>
* docs(doc/code-docs): add figure for training docs (#307 )
* add training image for docs
* docs(doc/code-docs): add training img for en doc
* docs(doc/code-docs): fix en docs for initialize
* docs(doc/code-docs): update conf file for readthedocs
* docs(doc/code-docs): fix typos
* docs(doc/code-docs): fix typos for reathedocs
* docs(doc/code-docs): minor typo fix for reathedocs
* docs(doc/code-docs): fix readthedocs conf file
* docs(doc/code-docs): update training image
* docs(doc/code-docs): fix typos
* docs(doc/code-docs): update training image
* docs(doc/code-docs): move training image to section initialize
* docs(doc/code-docs): fix lint
* add badge about reathedocs status
* Merge main to develop (#312 )
* fix(chat): fix stream_chat to return generator (#123 )
* fix(configs/7B_sft.py): model dtype float16 to bfloat16 (#302 )
* fix(convert2hf.py): fix the rotary_emb.inv_freq KeyError (#299 )
* docs(doc/code-docs): update quickstart usage (#301 )
* docs(usage.md): update usage.md
* docs(doc/code-docs): update en usage
---------
Co-authored-by: huangting4201 <huangting3@sensetime.com>
* docs(doc/code-docs): update en usage
---------
Co-authored-by: yingtongxiong <974106207@qq.com>
Co-authored-by: zhjunqin <zhjunqin@users.noreply.github.com>
Co-authored-by: jiangtann <39088437+jiangtann@users.noreply.github.com>
Co-authored-by: huangting4201 <huangting3@sensetime.com>
* feat: more tgs (#310 )
* feat:more tgs
* feat:add more tgs
* feat:more tgs
* feat: add optimizer_unitest (#303 )
* feat: add optimizer_unitest
* feat: add optimizer test
* feat: add optimizer test
* feat:add optimizer test
* fianl change
* feat:add optimizer test
* feat:add optimizer test
* feat:add optimizer test
---------
Co-authored-by: jiaxingli <43110891+li126com@users.noreply.github.com>
Co-authored-by: yingtongxiong <974106207@qq.com>
Co-authored-by: zhjunqin <zhjunqin@users.noreply.github.com>
Co-authored-by: jiangtann <39088437+jiangtann@users.noreply.github.com>
Co-authored-by: Season <caizheng@pjlab.org.cn>
Co-authored-by: huangting4201 <huangting3@sensetime.com>
2023-09-15 19:12:38 +08:00
de68cc5007
docs(doc/code-docs): add figure for training docs ( #307 )
...
* add training image for docs
* docs(doc/code-docs): add training img for en doc
* docs(doc/code-docs): fix en docs for initialize
* docs(doc/code-docs): update conf file for readthedocs
* docs(doc/code-docs): fix typos
* docs(doc/code-docs): fix typos for reathedocs
* docs(doc/code-docs): minor typo fix for reathedocs
* docs(doc/code-docs): fix readthedocs conf file
* docs(doc/code-docs): update training image
* docs(doc/code-docs): fix typos
* docs(doc/code-docs): update training image
* docs(doc/code-docs): move training image to section initialize
* docs(doc/code-docs): fix lint
* add badge about reathedocs status
2023-09-15 15:22:22 +08:00
06807a6fd5
docs(doc/code-docs): refine profiler docs ( #295 )
...
* add detailed profiler guide
* added torch profiler detailed docs
* add english docs for profiler page
* docs(code-docs/source/profiler.rst): resize profiler trace image
* docs(code-docs/source/profiler.rst): fix typo
* docs(doc/imgs/torch_profiler_trace.png): update trace image
2023-09-08 16:58:36 +08:00
b6d909d43e
docs(*): add documentation and reST files for readthedocs ( #272 )
...
* add initial reST files for readthedocs
* fix typos
* docs refine and minor fix
* add references for parallel training section
* fix reST format
* fix reST format
* fix reST format
* add comments for trainer API
* add link to step-by-step quickstart guide
* docs(code-docs/source/parallel.rst): add paper link url
* docs(code-docs/source/parallel.rst): add paper link url
* use MyST to render markdown
* docs(code-docs/source/initialize.rst): update model init
* add requirements for myst-parser
* reuse install and usage markdown
* docs(code-docs/source/index.rst): add example and q&a
* docs(doc/code-docs/*): docs refine
* docs(code-docs/source/parallel.rst): update docs for zero config
* docs(code-docs/source/example.rst): fix typos for example.rst
* docs(code-docs/source/example.rst): refine docs
* docs(code-docs/source/example): update example
* docs(code-docs/source/example): delete useless example
* docs(code-docs/source/*): fix image display issue
* docs(code-docs/source/parallel.rst): add docs for communication overlap
* docs(code-docs/source/conf.py): update conf.py
* docs(code-docs/source/example): update example 30B demo
* docs(code-docs/source/parallel.rst): update pipeline parallel
* docs(code-docs/source/parallel.rst): update pipeline parallel
* docs(code-docs/source/parallel.rst): update pipeline parallel
* docs(code-docs/source/parallel.rst): update pipeline parallel
* docs(code-docs/source/parallel.rst): update ZeRO1.5
* docs(code-docs/source/parallel.rst): update ZeRO1.5
* docs(code-docs/source): fix word spelling error
---------
Co-authored-by: huangting4201 <huangting3@sensetime.com>
2023-09-06 15:36:03 +08:00
fa7337b37b
initial commit
2023-07-06 12:55:23 +08:00
ytxiong