2 Commits (30a94431323d71c5ef06bd4b7f047aced3312fdf)

Author	SHA1	Message	Date
Guangyao Zhang	f20b066c59	[fp8] Disable all_gather intranode. Disable Redundant all_gather fp8 (#6059) ... * all_gather only internode, fix pytest * fix cuda arch <89 compile pytest error * fix pytest failure * disable all_gather_into_tensor_flat_fp8 * fix fp8 format * fix pytest * fix conversations * fix chunk tuple to list	2024-09-14 10:40:01 +08:00
Guangyao Zhang	53cb9606bd	[Feature] llama shardformer fp8 support (#5938) ... * add llama shardformer fp8 * Llama Shardformer Parity * fix typo * fix all reduce * fix pytest failure * fix reduce op and move function to fp8.py * fix typo	2024-08-05 10:05:47 +08:00