Downloads · 30 days
222
10% of all-time downloads
Spark-X2.5-4B-Uncensored-GGUF
toandev/Spark-X2.5-4B-Uncensored-GGUF
Spark-X2.5-4B-Uncensored-GGUF is a machine learning model from toandev. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
This repository contains GGUF quantized formats of toandev/Spark-X2.5-4B-Uncensored, fine-tuned/abliterated by Toan Doan (<[email protected]).
All-time downloads
2.1K
Public
Repo size
10.7 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.gguf10.7 GB · 100%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Sep 9, 2026
- Updated
- Sep 9, 2026
- SHA
- 8d13862e
Base models
Model card
From the Hugging Face model README
Spark-X2.5-4B-Uncensored - GGUF
This repository contains GGUF quantized formats of toandev/Spark-X2.5-4B-Uncensored, fine-tuned/abliterated by Toan Doan ([email protected]).
These quantized models are optimized for efficient local inference with llama.cpp, Ollama, LM Studio, and other compatible runtimes across consumer GPUs and CPUs.
Provided Quantizations
| File | Quant Method | File Size | Description |
|---|---|---|---|
Spark-X2.5-4B-Uncensored-Q4_K_M.gguf | Q4_K_M | 2.65 GB | Standard balanced 4-bit quant. Recommended for fast inference and GPUs with 4GB–6GB VRAM. |
Spark-X2.5-4B-Uncensored-Q5_K_M.gguf | Q5_K_M | 3.05 GB | 5-bit quant. Enhanced quality with minimal memory footprint (~6GB VRAM). |
Spark-X2.5-4B-Uncensored-Q8_0.gguf | Q8_0 | 4.50 GB | 8-bit quant. Near-original 16-bit precision. |
Reference & Evaluation Benchmarks
For complete details on the abliteration methodology, safety evaluation benchmarks across 5 standard datasets (AdvBench, MaliciousInstruct, JailbreakBench, HarmBench, StrongREJECT), and usage instructions, please refer to the primary model card:
- License
- apache-2.0
- Created
- Sep 9, 2026
- Updated
- Sep 9, 2026