mahihossain666

llama-2-70b-hf-quantized-3bits-GPTQ

mahihossain666/llama-2-70b-hf-quantized-3bits-GPTQ

llama-2-70b-hf-quantized-3bits-GPTQ is a text generation model from mahihossain666. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as pddl.

Quantized to 3bit precision using AutoGPTQ.