ColossalAI/colossalai/shardformer/layer
duanjunwen c82c75a9b4 Merge branch 'feature/zerobubble' of github.com:hpcaitech/ColossalAI into dev/zero_bubble 2024-11-01 03:32:18 +00:00
..
__init__.py Merge branch 'main' into dev/zero_bubble 2024-11-01 03:10:53 +00:00
_operation.py Merge branch 'main' into dev/zero_bubble 2024-11-01 03:10:53 +00:00
attn.py [Ring Attention] Improve comments (#6085) 2024-10-16 11:23:35 +08:00
dropout.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
embedding.py [zerobubble] rebase main (#6075) 2024-10-08 15:58:00 +08:00
linear.py Merge branch 'feature/zerobubble' of github.com:hpcaitech/ColossalAI into dev/zero_bubble 2024-11-01 03:32:18 +00:00
loss.py [zerobubble] rebase main (#6075) 2024-10-08 15:58:00 +08:00
normalization.py [fp8] Merge feature/fp8_comm to main branch of Colossalai (#6016) 2024-08-22 09:21:34 +08:00
parallel_module.py [shardformer] refactor embedding resize (#5603) 2024-04-18 16:10:18 +08:00
qkv_fused_linear.py [shardformer] optimize seq parallelism (#6086) 2024-10-11 13:44:40 +08:00
utils.py [Ring Attention] Improve comments (#6085) 2024-10-16 11:23:35 +08:00