Downloads · 30 days
173
21% of all-time downloads
Apertus-v1.1-4B-Instruct-GGUF
agentlans/Apertus-v1.1-4B-Instruct-GGUF
Apertus-v1.1-4B-Instruct-GGUF is a machine learning model from agentlans. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
This repository contains unofficial llama.cpp GGUF quantizations of swiss-ai/Apertus-v1.1-4B-Instruct, a distilled multilingual language model.
All-time downloads
810
Public
Repo size
9.3 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf9.3 GB · 100%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Sep 4, 2026
- Updated
- Sep 4, 2026
- SHA
- df3d1452
Base models
Datasets
Model card
From the Hugging Face model README
Apertus-v1.1-4B-Instruct-GGUF
This repository contains unofficial llama.cpp GGUF quantizations of swiss-ai/Apertus-v1.1-4B-Instruct, a distilled multilingual language model.
Quantized Files
| File Name | Description |
|---|---|
Q4_K_M.gguf | Balanced 4-bit quantization offering a strong trade-off between performance and memory usage. |
Q5_K_M.gguf | Higher-fidelity 5-bit quantization for improved output quality. |
Q8_0.gguf | Near-lossless 8-bit quantization. |
imatrix.dat | Importance matrix calibration data file generated during the quantization process. |
Calibration & Multilingual Preservation
These quantizations were built using an importance matrix (imatrix) generated from the eaddario/imatrix-calibration dataset (combined_all_medium). This dataset was specifically selected to safeguard and maintain the model's robust multilingual capabilities across lower-bit quants.
License
This project is licensed under the Apache 2.0 License, matching the licensing terms of the original model.
- License
- apache-2.0
- Created
- Sep 4, 2026
- Updated
- Sep 4, 2026