Downloads · 30 days
17
2% of all-time downloads
Meta-Llama-3-8B-Instruct-abliterated-v3-GPTQ-4bit
chplushsieh/Meta-Llama-3-8B-Instruct-abliterated-v3-GPTQ-4bit
Meta-Llama-3-8B-Instruct-abliterated-v3-GPTQ-4bit is a text generation model from chplushsieh. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama3.
This is a 4-bit GPTQ quantized model of failspy/Meta-Llama-3-8B-Instruct-abliterated-v3 It is quantized with wikitext2 dataset. Its file size is 5.73 GB, and can fit into a 8GB VRAM GPU.
All-time downloads
686
Public
Parameters
8B
5.7 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors5.7 GB · 100%
Parameter types
How the weights are stored.
I327B · 87%
Try a prompt
Model card
From the Hugging Face model README
Description
This is a 4-bit GPTQ quantized model of failspy/Meta-Llama-3-8B-Instruct-abliterated-v3
It is quantized with wikitext2 dataset.
Its file size is 5.73 GB, and can fit into a 8GB VRAM GPU.
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- llama3
- Created
- Jun 3, 2024
- Updated
- Jun 5, 2024