ColossalAI/colossalai/quantization
Guangyao Zhang 53cb9606bd
[Feature] llama shardformer fp8 support (#5938)
* add llama shardformer fp8

* Llama Shardformer Parity

* fix typo

* fix all reduce

* fix pytest failure

* fix reduce op and move function to fp8.py

* fix typo
2024-08-05 10:05:47 +08:00
..
__init__.py [Feature] qlora support (#5586) 2024-04-28 10:51:27 +08:00
bnb.py [quant] fix bitsandbytes version check (#5882) 2024-07-04 11:33:23 +08:00
bnb_config.py [Feature] qlora support (#5586) 2024-04-28 10:51:27 +08:00
fp8.py [Feature] llama shardformer fp8 support (#5938) 2024-08-05 10:05:47 +08:00