ColossalAI/colossalai/shardformer/layer
GuangyaoZhang 7a2b08646f Remove CohereLayerNorm and use existing layernorm 2024-06-18 02:32:41 +00:00
..
__init__.py Remove CohereLayerNorm and use existing layernorm 2024-06-18 02:32:41 +00:00
_operation.py [shardformer] Sequence Parallelism Optimization (#5533) 2024-04-03 17:15:47 +08:00
attn.py [Inference] Fix flash-attn import and add model test (#5794) 2024-06-12 14:13:50 +08:00
dropout.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
embedding.py [Inference] Fix bugs and docs for feat/online-server (#5598) 2024-05-08 15:20:53 +00:00
linear.py [shardformer] refactor embedding resize (#5603) 2024-04-18 16:10:18 +08:00
loss.py [Shardformer] Add parallel output for shardformer models(bloom, falcon) (#5702) 2024-05-21 11:07:13 +08:00
normalization.py Remove CohereLayerNorm and use existing layernorm 2024-06-18 02:32:41 +00:00
parallel_module.py [shardformer] refactor embedding resize (#5603) 2024-04-18 16:10:18 +08:00
qkv_fused_linear.py [shardformer] Sequence Parallelism Optimization (#5533) 2024-04-03 17:15:47 +08:00
utils.py [shardformer] Sequence Parallelism Optimization (#5533) 2024-04-03 17:15:47 +08:00