Downloads · 30 days
56
16% of all-time downloads
supra-50m-instruct-fp16-mlx
sahilchachra/supra-50m-instruct-fp16-mlx
supra-50m-instruct-fp16-mlx is a machine learning model from sahilchachra. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for mlx. The card lists the license as apache-2.0.
MLX quantization of SupraLabs/Supra-50M-Instruct for Apple Silicon.
All-time downloads
343
Public
Parameters
51.8M
208 MB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.gguf105 MB · 50%
At a glance
- Library
- mlx
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- Jun 12, 2026
- Updated
- Jun 12, 2026
- SHA
- a2f3ef9a
Base models
Model card
From the Hugging Face model README
supra-50m-instruct-fp16-mlx
MLX quantization of SupraLabs/Supra-50M-Instruct for Apple Silicon.
Variant: BFloat16 (lossless reference)
Disk size: 201 MB
Quantized by: sahilchachra
Benchmark results
Evaluated on Apple M4 Pro with MLX. Model loaded once; performance and quality measured in a single pass.
Performance
| This model | FP16 baseline | |
|---|---|---|
| Decode tok/s (avg, long traces) | 1270.13 | 1270.13 |
| Peak memory (GB) | 0.223 | 0.223 |
| Disk size (MB) | 201 | 201 |
Quality
| Benchmark | This model | FP16 baseline | n |
|---|---|---|---|
| IFEval (instruction following) | 15.9% | 15.9% | 44 |
| Alpaca-cleaned (instruct F1 vs reference) | 36.2 | 36.2 | 50 |
Context scaling (decode tok/s)
| Context length | Decode tok/s |
|---|---|
| ~128 tokens | 1294.4 |
| ~256 tokens | 1274.3 |
| ~512 tokens | 1277.6 |
| ~1024 tokens | 1234.2 |
Usage
pip install mlx-lm
from mlx_lm import load, generate
model, tokenizer = load("sahilchachra/supra-50m-instruct-fp16-mlx")
response = generate(model, tokenizer, prompt="Your prompt here", max_tokens=256, verbose=True)
All variants in this collection
| Model | Variant |
|---|---|
| sahilchachra/supra-50m-instruct-8bit-mlx | Affine int8 |
| sahilchachra/supra-50m-instruct-optiq-5bpw-mlx | OptiQ mixed-precision (target 5.0 bpw) |
Notes
- Requires Apple Silicon (M1 or later) with MLX
- Benchmarks run on Apple M4 Pro, 24 GB unified memory
- License: see SupraLabs/Supra-50M-Instruct for the original model's license
Original model
See SupraLabs/Supra-50M-Instruct for full model details and intended use.
- Library
- mlx
- Type
- llama
- License
- apache-2.0
- Created
- Jun 12, 2026
- Updated
- Jun 12, 2026