duanjunwen 9912cc8c07 [fix] fix bwd b; now bwd w only for Layer replaced by Linear1D_Col/Row; other layer perform a fully bwd;		2024-10-15 06:26:01 +00:00
..
__init__.py	[Feature] Zigzag Ring attention (#5905)	2024-08-16 13:56:38 +08:00
_operation.py	[fix] fix bwd b; now bwd w only for Layer replaced by Linear1D_Col/Row; other layer perform a fully bwd;	2024-10-15 06:26:01 +00:00
attn.py	[zerobubble] rebase main (#6075)	2024-10-08 15:58:00 +08:00
dropout.py	[misc] update pre-commit and run all files (#4752)	2023-09-19 14:20:26 +08:00
embedding.py	[zerobubble] rebase main (#6075)	2024-10-08 15:58:00 +08:00
linear.py	[fix] fix bwd b; now bwd w only for Layer replaced by Linear1D_Col/Row; other layer perform a fully bwd;	2024-10-15 06:26:01 +00:00
loss.py	[zerobubble] rebase main (#6075)	2024-10-08 15:58:00 +08:00
normalization.py	[Hotfix] Avoid fused RMSnorm import error without apex (#5985)	2024-08-09 18:17:09 +08:00
parallel_module.py	[shardformer] refactor embedding resize (#5603)	2024-04-18 16:10:18 +08:00
qkv_fused_linear.py	[zerobubble] rebase main (#6075)	2024-10-08 15:58:00 +08:00
utils.py	[zerobubble] rebase main (#6075)	2024-10-08 15:58:00 +08:00