Downloads · 30 days
261
3% of all-time downloads
tostideluxekaas/Llama-3.2-3B-Instruct-uncensored-GGUF
Llama-3.2-3B-Instruct-uncensored-GGUF is a text generation model from tostideluxekaas. Use it when you need the model to write or continue text. The card lists the license as other.
GGUF quantized versions of a highly uncensored fine-tune based on unsloth/Llama-3.2-3B-Instruct. Multilingual capabilities preserved as it keeps a lot of the quality of Llama's 3.2-3B-Instruct model because of the low…
Downloads · 30 days
261
3% of all-time downloads
All-time downloads
9.2K
Public
Repo size
14.2 GB
Likes
3
Public
Click a slice to open those files.
.gguf14.2 GB · 100%
From the Hugging Face model README
GGUF quantized versions of a highly uncensored fine-tune based on unsloth/Llama-3.2-3B-Instruct.
Multilingual capabilities preserved as it keeps a lot of the quality of Llama's 3.2-3B-Instruct model
because of the low Kl divergence (0.0265) after abliteration. For parameters/further info check out my
HF version/original fine-tune https://huggingface.co/tostideluxekaas/Llama-3.2-3B-Instruct-uncensored .
Only 4 out of 100 refusals in testing.
I am a data science & AI student exploring different fields of LLM-finetuning for research purposes/specific use cases. Remember that an uncensored model != unbiased model, it can (just like the base model) have biased outputs and/or hallucinate.
| File | Size | VRAM req. | Recommended for |
|---|---|---|---|
| Q4_K_M.gguf | 2.02GB | 3–4 GB | Best speed/quality balance (lightweight) |
| Q5_K_M.gguf | 2.32GB | 4–5 GB | Very good quality |
| Q8_0.gguf | 3.42GB | 5–6 GB | Highest quality |
| f16.gguf | 6.43GB | 8+ GB | Maximum precision / full model size |
This is a heavily uncensored model. It may generate harmful, illegal, offensive or inappropriate content. Use responsibly. You are solely responsible for all outputs and consequences.
Llama 3.2 Community License Copyright © Meta Platforms, Inc. All Rights Reserved. Built with Llama. Full license: https://github.com/meta-llama/llama-models/blob/main/models/llama3_2/LICENSE
look for tostideluxekaas/Llama-3.2-3B-Instruct-uncensored-GGUF in the search box
Select the appropiate quant (for reference see table)
Select download and wait for the model to complete the download, after this you are able to load it into you chat UI
ollama run huggingface.co/tostideluxekaas/Llama-3.2-3B-Instruct-uncensored-GGUF:Q4_K_M