Downloads · 30 days
12.8K
11% of all-time downloads
lemuralabs/Llama-3.2-3B-Uncensored-GGUF
Llama-3.2-3B-Uncensored-GGUF is a text generation model from lemuralabs. Use it when you need the model to write or continue text. It is set up for adapter-transformers. The card lists the license as apache-2.0.
<p align="center" <img src="logo.png" alt="Lemura Labs" width="110"/ </p
Downloads · 30 days
12.8K
11% of all-time downloads
All-time downloads
120K
Public
Repo size
31.8 GB
Likes
53
Public
Click a slice to open those files.
.gguf38.2 GB · 100%
From the Hugging Face model README
At Lemura Labs, we believe in pushing the boundaries of innovation by providing advanced and unrestricted AI models for every application. Dive into our world of possibilities and experience the freedom of Lemura Labs-Llama-3.2-3B-Uncensored, tailored to meet diverse needs with exceptional performance.
[
](https://github.com/Lemura Labs-Inc)
Explore Lemura Labs's Open-Source Projects on GitHub: [https://github.com/Lemura Labs-Inc](https://github.com/Lemura Labs-Inc)
To start using Lemura Labs-Llama-3.2-3B-Uncensored, follow the sample code below:
import torch
from transformers import pipeline
pipe = pipeline(
"text-generation",
model="lemuralabs/Lemura Labs-Llama-3.2-3B-Uncensored",
model_kwargs={"torch_dtype": torch.bfloat16},
device="cuda", # replace with "mps" to run on a Mac device
)
messages = [
{"role": "user", "content": "Tell me something fascinating."},
]
outputs = pipe(messages, max_new_tokens=256)
assistant_response = outputs[0]["generated_text"][-1]["content"].strip()
print(assistant_response)
| Quantized Model Version | Description |
|---|---|
| [Lemura Labs-Llama-3.2-3B-Uncensored-F16.gguf](https://huggingface.co/lemuralabs/Llama-3.2-3B-Uncensored-GGUF/blob/main/Lemura Labs-Llama-3.2-3B-Uncensored-F16.gguf) | Full 16-bit floating point precision for maximum accuracy on high-end GPUs. |
| model-Q2_K.gguf | Optimized for minimal memory usage with lower precision, suitable for edge cases. |
| model-Q3_K_L.gguf | Balanced precision with enhanced memory efficiency for medium-range devices. |
| model-Q3_K_M.gguf | Mid-range quantization for moderate precision and memory usage balance. |
| model-Q3_K_S.gguf | Smaller quantization steps, offering moderate precision with reduced memory use. |
| model-Q4_0_4_4.gguf | Performance-optimized for low memory, ideal for lightweight deployment. |
| model-Q4_0_4_8.gguf | Extended quantization balancing memory use and inference speed. |
| model-Q4_0_8_8.gguf | Advanced memory precision targeting larger contexts. |
| model-Q4_K_M.gguf | High-efficiency quantization for moderate GPU resources. |
| model-Q4_K_S.gguf | Optimized for smaller-scale operations with compact memory footprint. |
| model-Q5_K_M.gguf | Balances performance and precision, ideal for robust inferencing environments. |
| model-Q5_K_S.gguf | Moderate quantization targeting performance with minimal resource usage. |
| model-Q6_K.gguf | High-precision quantization for accurate and stable inferencing tasks. |
| model-TQ1_0.gguf | Experimental quantization for targeted applications in test environments. |
| model-TQ2_0.gguf | High-performance tuning for experimental use cases and flexible precision. |
The following fine-tuning datasets are leveraged to enhance specific model capabilities:
After fine-tuning with uncensored data, Lemura Labs-Llama-3.2-3B demonstrates superior performance compared to the original LLaMA model, particularly in accuracy and handling diverse, unrestricted scenarios.
| Benchmark | Metric | LLaMA 3.2 3B | Lemura Labs 3.2 3B | Observation |
|---|---|---|---|---|
| GPQA | Exact Match (Flexible) | 0.3 | 0.5 | Lemura Labs 3B demonstrates significant improvement, particularly in generative tasks. |
| Accuracy | 0.4 | 0.5 | Consistent improvement, especially in zero-shot scenarios. | |
| HellaSwag | Accuracy | 0.3 | 0.4 | Better performance in common sense reasoning tasks. |
| Normalized Accuracy | 0.3 | 0.4 | Enhanced ability to understand and predict context in sentence completion. | |
| Normalized Accuracy (Stderr) | 0.15275 | 0.1633 | Slightly improved consistency in normalized accuracy. | |
| Accuracy (Stderr) | 0.15275 | 0.1633 | Shows robustness in reasoning accuracy compared to LLaMA 3B. |
We welcome contributions to improve and extend the model’s capabilities. Stay tuned for updates on how to contribute.
For inquiries, collaborations, or further information, please reach out to us at info@Lemura Labs.
Dive into unrestricted creativity and innovation with Lemura Labs Llama 3.2 3B Uncensored!