Downloads · 30 days
30
31% of all-time downloads
Qwen3.5-0.8B-qcache-q8
DeepDavid/Qwen3.5-0.8B-qcache-q8
Qwen3.5-0.8B-qcache-q8 is a machine learning model from DeepDavid. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Quantized deployment artifacts for Qwen/Qwen3.5-0.8B.
All-time downloads
98
Public
Repo size
811 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf798 MB · 98%
At a glance
- License
- apache-2.0
- Model type
- qwen3_5
- Access
- Public
- Created
- Aug 5, 2026
- Updated
- Aug 5, 2026
- SHA
- 3ce7b2bd
Base models
Model card
From the Hugging Face model README
Qwen3.5-0.8B — Q8_0 weight cache + auxiliary tensors
Quantized deployment artifacts for Qwen/Qwen3.5-0.8B.
qcache-q8_0.v1.gguf— GGML Q8_0 tensors for the model's linear projections, stored in a GGUF container keyed by the original checkpoint tensor paths (no metadata KVs). Produced by in-memory quantization of the bf16 checkpoint with a candle-based loader.- Config and tokenizer files are copied unmodified from the base repository.
Format note: this is not a llama.cpp-compatible GGUF — tensors keep their original checkpoint names and only linear projections are quantized. Load it with a runtime that pairs the cache with the auxiliary safetensors.
Weights are redistributed under the same terms as the base model.
- Type
- qwen3_5
- License
- apache-2.0
- Created
- Aug 5, 2026
- Updated
- Aug 5, 2026