Downloads · 30 days
195
35% of all-time downloads
Mistral-Medium-3.5-128B-MLX-4bit
majentik/Mistral-Medium-3.5-128B-MLX-4bit
Mistral-Medium-3.5-128B-MLX-4bit is a image-text-to-text model from majentik. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for mlx. The card lists the license as other.
MLX 4bit (affine, group size 32) quantized variant of mistralai/Mistral-Medium-3.5-128B (text tower quantized; vision tower and projector retained in BF16; source checkpoint is FP8) for Apple silicon via mlx-lm.
All-time downloads
561
Public
Parameters
128B
85.8 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors85.7 GB · 100%
Parameter types
How the weights are stored.
U32123B · 97%
Try a prompt
Base models
Model card
From the Hugging Face model README
Mistral-Medium-3.5-128B-MLX-4bit
MLX 4bit (affine, group size 32) quantized variant of mistralai/Mistral-Medium-3.5-128B (text tower quantized; vision tower and projector retained in BF16; source checkpoint is FP8) for Apple silicon via mlx-lm.
Provenance
- Source: mistralai/Mistral-Medium-3.5-128B @ revision
22b2b868a15677cfa6061277ed2f653d1349a9ab(Modified MIT — revenue carve-out below $20M/month). - Quantized with
mlx_lm.convert(mlx-lm 0.31.3): affine, 4-bit, group size 32.
Smoke gate
Before upload this pack passed a deterministic coherence gate: greedy
48-token chat generation loaded through
mlx_lm.load, judged for emptiness, repetition loops, multi-script
gibberish, and special-token debris. Verdict: ok.
Usage
pip install mlx-lm
mlx_lm.generate --model majentik/Mistral-Medium-3.5-128B-MLX-4bit --prompt "Hello"
License
Modified MIT (upstream LICENSE): free use with a revenue carve-out — organisations
above $20M/month revenue need a commercial agreement with Mistral AI. This is not a
plain MIT license; read the upstream terms before commercial deployment.
Evaluation
| Benchmark | Score |
|---|---|
| arc_easy_acc | 0.7950 |
| hellaswag_acc | 0.5100 |
Available tiers
- Task
- Image-Text-to-Text
- Library
- mlx
- Type
- mistral3
- License
- other
- Created
- Aug 11, 2026
- Updated
- Aug 15, 2026