github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
ColossalAI/colossalai
History
Baizhou Zhang f911d5b09d
[doc] Add user document for Shardformer (#4702) 
* create shardformer doc files

* add docstring for seq-parallel

* update ShardConfig docstring

* add links to llama example

* add outdated massage

* finish introduction & supporting information

* finish 'how shardformer works'

* finish shardformer.md English doc

* fix doctest fail

* add Chinese document
 		2023-09-15 10:56:39 +08:00
..
_C
…
_analyzer
…
amp [pipeline] support fp32 for HybridPlugin/merge shardformer test and pipeline test into one file (#4354) 2023-08-15 23:25:14 +08:00
auto_parallel [legacy] move communication and nn to legacy and refactor logger (#4671) 2023-09-11 16:24:28 +08:00
autochunk
…
booster [doc] Add user document for Shardformer (#4702) 2023-09-15 10:56:39 +08:00
checkpoint_io [hotfix] fix typo in hybrid parallel io (#4697) 2023-09-12 17:32:19 +08:00
cli [legacy] move communication and nn to legacy and refactor logger (#4671) 2023-09-11 16:24:28 +08:00
cluster [shardformer] support interleaved pipeline (#4448) 2023-08-16 19:29:03 +08:00
context [legacy] move builder and registry to legacy (#4603) 2023-09-05 21:53:10 +08:00
device fix some typo with colossalai/device colossalai/tensor/ etc. (#4171) 2023-09-12 17:41:52 +08:00
fx
…
inference [hotfix] Fix import error: colossal.kernel without triton installed (#4722) 2023-09-14 18:03:55 +08:00
interface [zero] hotfix master param sync (#4618) 2023-09-05 15:04:02 +08:00
kernel [hotfix] Fix import error: colossal.kernel without triton installed (#4722) 2023-09-14 18:03:55 +08:00
lazy [shardformer] support lazy init (#4202) 2023-08-15 23:25:14 +08:00
legacy [legacy] move communication and nn to legacy and refactor logger (#4671) 2023-09-11 16:24:28 +08:00
logging [legacy] move communication and nn to legacy and refactor logger (#4671) 2023-09-11 16:24:28 +08:00
nn [legacy] move communication and nn to legacy and refactor logger (#4671) 2023-09-11 16:24:28 +08:00
pipeline [legacy] move communication and nn to legacy and refactor logger (#4671) 2023-09-11 16:24:28 +08:00
shardformer [doc] Add user document for Shardformer (#4702) 2023-09-15 10:56:39 +08:00
tensor fix some typo with colossalai/device colossalai/tensor/ etc. (#4171) 2023-09-12 17:41:52 +08:00
testing Next commit [checkpointio] Unsharded Optimizer Checkpoint for Gemini Plugin (#4141) 2023-07-07 16:33:06 +08:00
utils [legacy] move communication and nn to legacy and refactor logger (#4671) 2023-09-11 16:24:28 +08:00
zero [legacy] move communication and nn to legacy and refactor logger (#4671) 2023-09-11 16:24:28 +08:00
__init__.py
…
constants.py
…
core.py
…
global_variables.py
…
initialize.py [legacy] move builder and registry to legacy (#4603) 2023-09-05 21:53:10 +08:00