ColossalAI/colossalai/shardformer/shard
Baizhou Zhang f911d5b09d
[doc] Add user document for Shardformer (#4702)
* create shardformer doc files

* add docstring for seq-parallel

* update ShardConfig docstring

* add links to llama example

* add outdated massage

* finish introduction & supporting information

* finish 'how shardformer works'

* finish shardformer.md English doc

* fix doctest fail

* add Chinese document
2023-09-15 10:56:39 +08:00
..
__init__.py [shardformer] Refactor shardformer api (#4001) 2023-07-04 16:05:01 +08:00
shard_config.py [doc] Add user document for Shardformer (#4702) 2023-09-15 10:56:39 +08:00
sharder.py [Feature] The first PR to Add TP inference engine, kv-cache manager and related kernels for our inference system (#4577) 2023-09-12 01:22:56 +08:00
shardformer.py [shardformer] rename policy file name 2023-08-15 23:25:14 +08:00
utils.py [pipeline] update shardformer policy 2023-08-15 23:25:14 +08:00