Downloads · 30 days
11
4% of all-time downloads
phatvo/Llama-3.1-8B-Instruct-RAFT-GPTQ-4bits
Llama-3.1-8B-Instruct-RAFT-GPTQ-4bits is a text generation model from phatvo. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama3.1.
4bit Quantized of phatvo/Meta-Llama3.1-8B-Instruct-RAFT
Downloads · 30 days
11
4% of all-time downloads
All-time downloads
262
Public
Parameters
8B
5.7 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors5.7 GB · 100%
How the weights are stored.
I327B · 87%
From the Hugging Face model README
4bit Quantized of phatvo/Meta-Llama3.1-8B-Instruct-RAFT