Downloads · 30 days
417
10% of all-time downloads
Spark-X2.5-1.7B-GGUF
ngquocvinh/Spark-X2.5-1.7B-GGUF
Spark-X2.5-1.7B-GGUF is a text generation model from ngquocvinh. Use it when you need the model to write or continue text. It is set up for llama.cpp. The card lists the license as apache-2.0.
Community GGUF quantizations of XHToken/Spark-X2.5-1.7B. This repository contains nine quantized files for local inference. No training or fine-tuning was performed.
All-time downloads
4.3K
Public
Repo size
9 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.gguf9 GB · 100%
At a glance
- Task
- Text Generation
- Library
- llama.cpp
- License
- apache-2.0
- Access
- Public
- Created
- Sep 6, 2026
- Updated
- Sep 13, 2026
- SHA
- 1cc70b9e
Try a prompt
Base models
Model card
From the Hugging Face model README
Spark-X2.5-1.7B GGUF
Community GGUF quantizations of XHToken/Spark-X2.5-1.7B. This repository contains nine quantized files for local inference. No training or fine-tuning was performed.
<div align="center" style="background-color:#f59e0b;color:#ffffff;padding:16px 20px;border-radius:10px;line-height:1.7;"> ☕ If this GGUF made your day easier, a coffee would make mine.<br> <a href="https://ko-fi.com/ngquocvinh" style="color:#ffffff;"><strong style="color:#ffffff;">Send a coffee ☕</strong></a><br> I build and test these releases myself. Your coffee helps keep me going.<br> Thank you for supporting this work. </div>Files
| Quantization | File size (GiB) | A10M generation token/s | Validation | Recommendation / Notes |
|---|---|---|---|---|
| Q8_0 | 1.70 | 175.54 | Load/generate pass | High quality. |
| Q6_K | 1.31 | 199.07 | Load/generate pass | High quality. |
| Q5_K_M | 1.17 | 223.04 | Load/generate pass | Daily use. |
| Q4_K_M | 1.03 | 241.87 | Load/generate pass | Recommended default. |
| Q3_K_M | 0.87 | 203.60 | Load/generate pass | Lower-memory profile. |
| Q2_K | 0.74 | 231.70 | Load/generate pass | Aggressive low-memory profile. |
| IQ2_XS | 0.61 | 245.03 | Load/generate pass | Experimental. |
| IQ1_M | 0.54 | 252.02 | Load/generate pass | Experimental. |
| Q1_0 | 0.40 | 336.65 | Load/generate pass | Experimental / legacy minimum-memory option. |
The A10M generation figures were measured with single-stream llama-bench on
an NVIDIA A10M.
Q1/Q2 and the IQ variants can lose instruction following, reasoning, and tool-call reliability. Validate the chosen file on the workload that matters to you.
License and attribution
The upstream model is released under Apache License 2.0. Preserve the upstream attribution and license when redistributing these derivative files. This is a community GGUF quantization, not an official XHToken/SparkLLM release or endorsement.
Checksums are available in SHA256SUMS.txt.
- Task
- Text Generation
- Library
- llama.cpp
- License
- apache-2.0
- Created
- Sep 6, 2026
- Updated
- Sep 13, 2026