Downloads · 30 days
14
2% of all-time downloads
Qwen3.5-2B-LQ8-GGUF
reecdev/Qwen3.5-2B-LQ8-GGUF
Qwen3.5-2B-LQ8-GGUF is a text generation model from reecdev. Use it when you need the model to write or continue text.
<img src="https://cdn-uploads.huggingface.co/production/uploads/691e7dc28f82cd99d6701f56/ywJgFra8u-dD1UQEWt3W.png" width="500"
All-time downloads
610
Public
Repo size
1.8 GB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.gguf1.8 GB · 100%
At a glance
- Task
- Text Generation
- Access
- Public
- Created
- Jun 14, 2026
- Updated
- Jun 14, 2026
- SHA
- ecd58515
Try a prompt
Base models
Model card
From the Hugging Face model README
<img src="https://cdn-uploads.huggingface.co/production/uploads/691e7dc28f82cd99d6701f56/ywJgFra8u-dD1UQEWt_3W.png" width="500">
[!Note] This repository contains model weights for the unofficial LQ8 quantizations of Qwen3.5 2B.
LQ8 is an experimental quantization technique that is still in early beta, designed to provide fp16-level quality with the same or lower memory footprint as Q8_0.
LQ8 is currently compatible with llama.cpp and Ollama out of the box. Please create a discussion if you find a bug.
| File Name | Quant Type | Bit Depth | Size | Download Link |
|---|---|---|---|---|
model-LQ8.gguf | LQ8 | ~8 bpw | 1.82 GB | 📥 Download LQ8 |
- Task
- Text Generation
- Created
- Jun 14, 2026
- Updated
- Jun 14, 2026