You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
ColossalAI/colossalai/shardformer/layer
duanjunwen 014afbdb59
[fix] fix attn
1 week ago
..
__init__.py Merge branch 'main' into dev/zero_bubble 3 weeks ago
_operation.py [fix] fix use_fp8 flag 3 weeks ago
attn.py [fix] fix attn 1 week ago
dropout.py
embedding.py
linear.py Merge branch 'feature/zerobubble' of github.com:hpcaitech/ColossalAI into dev/zero_bubble 3 weeks ago
loss.py
normalization.py
parallel_module.py
qkv_fused_linear.py
utils.py [Ring Attention] Improve comments (#6085) 1 month ago