9 Commits (d383449fc4300ae3caf9cf481fc87bb4757f00a4)

Author SHA1 Message Date
flybird11111 20722a8c93
[fp8]update reduce-scatter test (#6002) 3 months ago
flybird11111 597b206001
[fp8] support asynchronous FP8 communication (#5997) 3 months ago
Hongxin Liu 8241c0c054
[fp8] support gemini plugin (#5978) 4 months ago
Hanks b480eec738
[Feature]: support FP8 communication in DDP, FSDP, Gemini (#5928) 4 months ago
Hongxin Liu ccabcf6485
[fp8] support fp8 amp for hybrid parallel plugin (#5975) 4 months ago
Hongxin Liu 76ea16466f
[fp8] add fp8 linear (#5967) 4 months ago
flybird11111 afb26de873
[fp8]support all2all fp8 (#5953) 4 months ago
Guangyao Zhang 53cb9606bd
[Feature] llama shardformer fp8 support (#5938) 4 months ago
Hongxin Liu 5fd0592767
[fp8] support all-gather flat tensor (#5932) 4 months ago