ColossalAI/colossalai/shardformer/layer
wangbluo 4cf79fa275 merge 2024-08-17 09:34:18 +00:00
..
__init__.py [Feature] Zigzag Ring attention (#5905) 2024-08-16 13:56:38 +08:00
_operation.py merge 2024-08-17 09:34:18 +00:00
attn.py merge 2024-08-17 09:34:18 +00:00
dropout.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
embedding.py [fp8] support hybrid parallel plugin (#5982) 2024-08-12 18:17:05 +08:00
linear.py merge 2024-08-17 09:34:18 +00:00
loss.py merge 2024-08-17 09:34:18 +00:00
normalization.py [Hotfix] Avoid fused RMSnorm import error without apex (#5985) 2024-08-09 18:17:09 +08:00
parallel_module.py [shardformer] refactor embedding resize (#5603) 2024-04-18 16:10:18 +08:00
qkv_fused_linear.py [fp8] support hybrid parallel plugin (#5982) 2024-08-12 18:17:05 +08:00
utils.py [Feature] Zigzag Ring attention (#5905) 2024-08-16 13:56:38 +08:00