Downloads · 30 days
139
3% of all-time downloads
VersatiLlama-Llama-3.2-3B-Instruct-Abliterated-Imatrix-GGUF
Devarui379/VersatiLlama-Llama-3.2-3B-Instruct-Abliterated-Imatrix-GGUF
VersatiLlama-Llama-3.2-3B-Instruct-Abliterated-Imatrix-GGUF is a text generation model from Devarui379. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-4.0.
All-time downloads
4.1K
Public
Repo size
12.9 GB
Likes
5
Public
Repo makeup
Click a slice to open those files.
.gguf12.9 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- cc-by-4.0
- Access
- Public
- Created
- Oct 2, 2024
- Updated
- Oct 2, 2024
- SHA
- 3d6d8f2b
Try a prompt
Base models
Model card
From the Hugging Face model README
Model Card for Model ID
VersatiLlama-Llama-3.2-3B-Instruct-Abliterated-Imatrix-GGUF
Model Description
Small but Capable
Fine-Tuned on Vast dataset of Conversations and Abliterated for freedom of use.
Able to Generate Human like text with high performance within its size.
It is very versatile when compared for it's size and Parameters and offers capability almost as good as Llama 3.1 8B Instruct
Feel free to Check it out!!
Check the safetensors version of the model here : Devarui379/VersatiLlama-Llama-3.2-3B-Instruct-Abliterated
[This model was trained for 5hrs on GPU T4 15gb vram]
- Developed by: Meta AI
- Fine-Tuned by: Devarui379
- Model type: Transformers
- Language(s) (NLP): English
- License: cc-by-4.0
Model Sources [optional]
base model:meta-llama/Llama-3.2-3B-Instruct
- Repository: VersatiLlama-Llama-3.2-3B-Instruct-Abliterated-Imatrix-GGUF
- Demo: Use LM Studio
Uses
Use desired System prompt when using in LM Studio The optimal chat template seems to be Jinja but feel free to test it out as you want!
Technical Specifications
Model Architecture and Objective
Llama 3.2
Hardware
NVIDIA TESLA T4 GPU 15GB VRAM
- Task
- Text Generation
- Library
- transformers
- License
- cc-by-4.0
- Languages
- en
- Created
- Oct 2, 2024
- Updated
- Oct 2, 2024