ISTA-DASLab

Llama-3.1-8B-Instruct-MatGPTQ

ISTA-DASLab/Llama-3.1-8B-Instruct-MatGPTQ

Llama-3.1-8B-Instruct-MatGPTQ is a text generation model from ISTA-DASLab. Use it when you need the model to write or continue text.

This is the official MatGPTQ checkpoint of meta-llama/Llama-3.1-8B-Instruct, produced as described in the "MatGPTQ: Accurate and Efficient Post-Training Matryoshka Quantization" paper.