HandH1998

QQQ-Llama-3-8b

HandH1998/QQQ-Llama-3-8b

QQQ-Llama-3-8b is a text generation model from HandH1998. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.

This is the INT4 Llama-3-8b model quantized by per-channel QQQ. QQQ is an innovative and hardware-optimized W4A8 quantization solution. For more details, please refer to our code repo and our paper.