Commit Graph

2 Commits (2f583c154944b1f00d7a4fb1ce529db9d8595056)

Author SHA1 Message Date
flybird11111 20722a8c93
[fp8]update reduce-scatter test (#6002)
* fix

* fix

* fix

* fix
2024-08-15 14:40:54 +08:00
Guangyao Zhang 53cb9606bd
[Feature] llama shardformer fp8 support (#5938)
* add llama shardformer fp8

* Llama Shardformer Parity

* fix typo

* fix all reduce

* fix pytest failure

* fix reduce op and move function to fp8.py

* fix typo
2024-08-05 10:05:47 +08:00