ColossalAI/colossalai
Baizhou Zhang f911d5b09d
[doc] Add user document for Shardformer (#4702)
* create shardformer doc files

* add docstring for seq-parallel

* update ShardConfig docstring

* add links to llama example

* add outdated massage

* finish introduction & supporting information

* finish 'how shardformer works'

* finish shardformer.md English doc

* fix doctest fail

* add Chinese document
2023-09-15 10:56:39 +08:00
..
_C
_analyzer
amp
auto_parallel [legacy] move communication and nn to legacy and refactor logger (#4671) 2023-09-11 16:24:28 +08:00
autochunk
booster [doc] Add user document for Shardformer (#4702) 2023-09-15 10:56:39 +08:00
checkpoint_io [hotfix] fix typo in hybrid parallel io (#4697) 2023-09-12 17:32:19 +08:00
cli [legacy] move communication and nn to legacy and refactor logger (#4671) 2023-09-11 16:24:28 +08:00
cluster
context
device fix some typo with colossalai/device colossalai/tensor/ etc. (#4171) 2023-09-12 17:41:52 +08:00
fx
inference [hotfix] Fix import error: colossal.kernel without triton installed (#4722) 2023-09-14 18:03:55 +08:00
interface
kernel [hotfix] Fix import error: colossal.kernel without triton installed (#4722) 2023-09-14 18:03:55 +08:00
lazy
legacy [legacy] move communication and nn to legacy and refactor logger (#4671) 2023-09-11 16:24:28 +08:00
logging [legacy] move communication and nn to legacy and refactor logger (#4671) 2023-09-11 16:24:28 +08:00
nn [legacy] move communication and nn to legacy and refactor logger (#4671) 2023-09-11 16:24:28 +08:00
pipeline [legacy] move communication and nn to legacy and refactor logger (#4671) 2023-09-11 16:24:28 +08:00
shardformer [doc] Add user document for Shardformer (#4702) 2023-09-15 10:56:39 +08:00
tensor fix some typo with colossalai/device colossalai/tensor/ etc. (#4171) 2023-09-12 17:41:52 +08:00
testing
utils [legacy] move communication and nn to legacy and refactor logger (#4671) 2023-09-11 16:24:28 +08:00
zero [legacy] move communication and nn to legacy and refactor logger (#4671) 2023-09-11 16:24:28 +08:00
__init__.py
constants.py
core.py
global_variables.py
initialize.py