Downloads · 30 days
664
68% of all-time downloads
Apertus-v1.1-4B-Instruct-GGUF
jondale/Apertus-v1.1-4B-Instruct-GGUF
Apertus-v1.1-4B-Instruct-GGUF is a text generation model from jondale. Use it when you need the model to write or continue text. It is set up for gguf. The card lists the license as apache-2.0.
Quantized from swiss-ai/Apertus-v1.1-4B-Instruct. All credit to Swiss AI - this is only a format conversion.
All-time downloads
980
Public
Repo size
6.5 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf6.5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- gguf
- License
- apache-2.0
- Access
- Public
- Created
- Aug 2, 2026
- Updated
- Aug 2, 2026
- SHA
- f2e7f396
Base models
Model card
From the Hugging Face model README
Apertus v1.1 4B Instruct - GGUF
Quantized from swiss-ai/Apertus-v1.1-4B-Instruct. All credit to Swiss AI - this is only a format conversion.
Why another one
The other quantized 4B GGUFs available lost their chat template somewhere in conversion.
Without it llama.cpp falls back to ChatML, whose <|im_start|> and <|im_end|>
are not tokens in this vocabulary, so nothing ever ends a turn - the model
writes both sides of the conversation until it hits your token limit.
Files
| Size | ||
|---|---|---|
apertus-v1.1-4b-instruct-q8_0.gguf | 4.1 GB | basically lossless, start here |
apertus-v1.1-4b-instruct-q4_k_m.gguf | 2.4 GB | smaller and quicker, a bit worse |
Running it
llama-server -m apertus-v1.1-4b-instruct-q8_0.gguf --ctx-size 4096
4096 is what it was trained on.
Made with
docker run --rm -v ./source:/src:ro -v ./out:/models \
ghcr.io/ggml-org/llama.cpp:full \
--convert /src --outfile /models/f16.gguf --outtype f16
docker run --rm -v ./out:/models ghcr.io/ggml-org/llama.cpp:full \
--quantize /models/f16.gguf /models/apertus-v1.1-4b-instruct-q8_0.gguf Q8_0
llama.cpp build FILL IN.
- Task
- Text Generation
- Library
- gguf
- License
- apache-2.0
- Languages
- multilingual
- Created
- Aug 2, 2026
- Updated
- Aug 2, 2026