mirror of https://github.com/hpcaitech/ColossalAI
59e252ecdb
* [shardformer] chatglm support sequence parallel [shardformer] chatglm support sequence parallel [shardformer] chatglm support sequence parallel [shardformer] chatglm support sequence parallel [shardformer] chatglm support sequence parallel [shardformer] chatglm support sequence parallel * fix fix fix fix |
||
---|---|---|
.. | ||
__init__.py | ||
_operation.py | ||
dropout.py | ||
embedding.py | ||
linear.py | ||
loss.py | ||
normalization.py | ||
parallel_module.py | ||
qkv_fused_linear.py | ||
utils.py |