ColossalAI/colossalai
Baizhou Zhang f911d5b09d
[doc] Add user document for Shardformer (#4702)
* create shardformer doc files

* add docstring for seq-parallel

* update ShardConfig docstring

* add links to llama example

* add outdated massage

* finish introduction & supporting information

* finish 'how shardformer works'

* finish shardformer.md English doc

* fix doctest fail

* add Chinese document
2023-09-15 10:56:39 +08:00
..
_C
_analyzer
amp
auto_parallel
autochunk
booster [doc] Add user document for Shardformer (#4702) 2023-09-15 10:56:39 +08:00
checkpoint_io [hotfix] fix typo in hybrid parallel io (#4697) 2023-09-12 17:32:19 +08:00
cli
cluster
context
device fix some typo with colossalai/device colossalai/tensor/ etc. (#4171) 2023-09-12 17:41:52 +08:00
fx
inference [hotfix] Fix import error: colossal.kernel without triton installed (#4722) 2023-09-14 18:03:55 +08:00
interface
kernel [hotfix] Fix import error: colossal.kernel without triton installed (#4722) 2023-09-14 18:03:55 +08:00
lazy
legacy
logging
nn
pipeline
shardformer [doc] Add user document for Shardformer (#4702) 2023-09-15 10:56:39 +08:00
tensor fix some typo with colossalai/device colossalai/tensor/ etc. (#4171) 2023-09-12 17:41:52 +08:00
testing
utils
zero
__init__.py
constants.py
core.py
global_variables.py
initialize.py