Edenzzzz f1c3266a94 overlap kv comm with output rescale (#6017) ... Co-authored-by: Edenzzzz <wtan45@wisc.edu>		2024-08-19 14:08:17 +08:00
..
__init__.py	[Feature] Zigzag Ring attention (#5905)	2024-08-16 13:56:38 +08:00
_operation.py	[Feature] Zigzag Ring attention (#5905)	2024-08-16 13:56:38 +08:00
attn.py	overlap kv comm with output rescale (#6017)	2024-08-19 14:08:17 +08:00
dropout.py	[misc] update pre-commit and run all files (#4752)	2023-09-19 14:20:26 +08:00
embedding.py	[Inference] Fix bugs and docs for feat/online-server (#5598)	2024-05-08 15:20:53 +00:00
linear.py	[Feature] Zigzag Ring attention (#5905)	2024-08-16 13:56:38 +08:00
loss.py	[Feature] Zigzag Ring attention (#5905)	2024-08-16 13:56:38 +08:00
normalization.py	[Hotfix] Avoid fused RMSnorm import error without apex (#5985)	2024-08-09 18:17:09 +08:00
parallel_module.py	[shardformer] refactor embedding resize (#5603)	2024-04-18 16:10:18 +08:00
qkv_fused_linear.py	Add n_fused as an input from native_module (#5894)	2024-07-23 23:15:39 +08:00
utils.py	[Feature] Zigzag Ring attention (#5905)	2024-08-16 13:56:38 +08:00