Downloads · 30 days
19
8% of all-time downloads
apertus-4b-r2-Q5_K_M.gguf
SH4P3S/apertus-4b-r2-Q5_K_M.gguf
apertus-4b-r2-Q5_K_M.gguf is a machine learning model from SH4P3S. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Round-2 QLoRA tool-use fine-tune of swiss-ai/Apertus-v1.1-4B-Instruct, quantized to Q5KM for llama.cpp (converted from f16, never quant→quant).
All-time downloads
242
Public
Repo size
2.8 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf2.8 GB · 100%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Jul 12, 2026
- Updated
- Jul 12, 2026
- SHA
- 8b2f3a9e
Base models
Model card
From the Hugging Face model README
apertus-4b-r2-Q5_K_M
Round-2 QLoRA tool-use fine-tune of swiss-ai/Apertus-v1.1-4B-Instruct, quantized to Q5_K_M for llama.cpp (converted from f16, never quant→quant).
Round-2 changes vs round 1: direct weather/fetch tool selection (no forced chaining), notes answers stay grounded in note hits, date anchoring (Current date: <Weekday>, <YYYY-MM-DD> as the last system-prompt line — the runtime must inject it), and a higher share of clarifying questions.
Intended to run with its paired system prompt and tools.gbnf grammar (lazy-triggered on <tool_call>); sampling temp 0.8, top_p 0.9, repeat_penalty 1.0, context 4096.
- File:
apertus-4b-r2-Q5_K_M.gguf - Size: 2,777,042,176 bytes
- SHA-256:
5219675afd2da7108c56f43284945b39e76e1e1d5aae1aca85a630c98d664794
- License
- apache-2.0
- Created
- Jul 12, 2026
- Updated
- Jul 12, 2026