Downloads · 30 days
33
28% of all-time downloads
TyKaoz/Apertus-v1.5-8B-text-8bit
Apertus-v1.5-8B-text-8bit is a text generation model from TyKaoz. Use it when you need the model to write or continue text. It is set up for mlx. The card lists the license as apache-2.0.
8-bit MLX quantization of swiss-ai/Apertus-v1.5-8B, for Apple Silicon (~8.0 GB). Text branch of the omni checkpoint (the image and audio towers and codebooks are not included), extracted from the original weights and…
Downloads · 30 days
33
28% of all-time downloads
All-time downloads
120
Public
Parameters
8.1B
8.6 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors8.6 GB · 100%
How the weights are stored.
U328.1B · 100%
From the Hugging Face model README
8-bit MLX quantization of
swiss-ai/Apertus-v1.5-8B, for Apple Silicon (~8.0 GB).
Text branch of the omni checkpoint (the image and audio towers and codebooks are not included), extracted from the original weights and quantized with mlx-lm. xIELU activation, 262144-token context, the source tokenizer and chat template. Apertus is the fully open model of the Swiss AI Initiative (EPFL, ETH Zurich, CSCS).
pip install -U mlx-lm
mlx_lm.generate \
--model TyKaoz/Apertus-v1.5-8B-text-8bit \
--prompt "Explique la quantization en une phrase." \
--max-tokens 200
| Base | Tool | Precision | Size |
|---|---|---|---|
swiss-ai/Apertus-v1.5-8B | mlx-lm | 8-bit · group 64 | ~8.0 GB |
By TyKaoz — privacy-first native macOS LLM chat client. Apache 2.0, inherited from the base model, with the Apertus acceptable use policy.