Downloads · 30 days
131
5% of all-time downloads
RichardErkhov/Devarui379_-_VersatiLlama-Llama-3.2-3B-Instruct-Abliterated-gguf
Devarui379_-_VersatiLlama-Llama-3.2-3B-Instruct-Abliterated-gguf is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Downloads · 30 days
131
5% of all-time downloads
All-time downloads
2.6K
Public
Repo size
33.5 GB
Likes
0
Public
Click a slice to open those files.
.gguf39.5 GB · 100%
From the Hugging Face model README
Quantization made by Richard Erkhov.
VersatiLlama-Llama-3.2-3B-Instruct-Abliterated - GGUF
base_model:

Small but Smart
Fine-Tuned on Vast dataset of Conversations
Able to Generate Human like text with high performance within its size.
It is Very Versatile when compared for it's size and Parameters and offers capability almost as good as Llama 3.1 8B Instruct
Feel free to Check it out!!
Check the quantized model here: Devarui379/VersatiLlama-Llama-3.2-3B-Instruct-Abliterated-Imatrix-GGUF
[This model was trained for 5hrs on GPU T4 15gb vram]
base model:meta-llama/Llama-3.2-3B-Instruct
Use desired System prompt when using in LM Studio The optimal chat template seems to be Jinja but feel free to test it out as you want!
Llama 3.2
NVIDIA TESLA T4 GPU 15GB VRAM