HandH1998

QQQ-Llama-3-8b-g128

HandH1998/QQQ-Llama-3-8b-g128

QQQ-Llama-3-8b-g128 is a text generation model from HandH1998. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.

This is the INT4 Llama-3-8b model quantized by per-group QQQ and the group size is 128. QQQ is an innovative and hardware-optimized W4A8 quantization solution. For more details, please refer to our code repo and our p…