Downloads · 30 days
26
8% of all-time downloads
Phi-4-mini-instruct-MLX-8bit
Irfanuruchi/Phi-4-mini-instruct-MLX-8bit
Phi-4-mini-instruct-MLX-8bit is a text generation model from Irfanuruchi. Use it when you need the model to write or continue text. It is set up for mlx. The card lists the license as mit.
This is an 8-bit MLX quantized version of microsoft/Phi-4-mini-instruct, offering higher quality output at the cost of increased memory usage.
All-time downloads
342
Public
Parameters
3.8B
4.1 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors4.1 GB · 100%
Parameter types
How the weights are stored.
U323.8B · 100%
Base models
Model card
From the Hugging Face model README
Phi-4-mini-instruct (MLX 8-bit)
This is an 8-bit MLX quantized version of microsoft/Phi-4-mini-instruct, offering higher quality output at the cost of increased memory usage.
Benchmark Environment
- Device: MacBook Pro (M3 Pro)
- Runtime: MLX
- Precision: 8-bit (~8.5 bits per weight)
Performance (Measured)
- Disk size: ~3.8 GB
- Peak memory: ~4.15 GB
- Generation speed: ~32 tokens/sec
Benchmarks were collected on macOS (M3 Pro).
iPhone / iPad performance will vary depending on hardware and memory.
Usage
mlx_lm.generate \
--model Irfanuruchi/Phi-4-mini-instruct-MLX-8bit \
--prompt "Write a 1-paragraph plan for learning Spanish in 30 days." \
--max-tokens 160
License
Original model license applies. See microsoft/Phi-4-mini-instruct.
- Task
- Text Generation
- Library
- mlx
- Type
- phi3
- License
- mit
- Languages
- multilingual, ar, zh, cs, da, nl
- Created
- Jan 11, 2026
- Updated
- Jan 17, 2026