Downloads · 30 days
111
19% of all-time downloads
granite-4.2-3b-MLX-4bit
Orvena/granite-4.2-3b-MLX-4bit
granite-4.2-3b-MLX-4bit is a text generation model from Orvena. Use it when you need the model to write or continue text. It is set up for mlx. The card lists the license as apache-2.0.
A 4-bit MLX quantization of ibm-granite/granite-4.2-3b, converted with mlx-lm 0.31.3.
All-time downloads
589
Public
Parameters
3.7B
2.1 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors2.1 GB · 100%
Parameter types
How the weights are stored.
U323.7B · 100%
Try a prompt
Base models
Model card
From the Hugging Face model README
granite-4.2-3b-MLX-4bit
A 4-bit MLX quantization of ibm-granite/granite-4.2-3b, converted with mlx-lm 0.31.3.
- Quantization: 4 bit, group size 64 (4.501 bits per weight)
- Weights: 2.06 GB safetensors
- Context length: 131,072 tokens
- Chat template, thinking mode, and tool calling are inherited unchanged from the base model
- License: Apache 2.0, same as the base model
Use with mlx-lm
pip install mlx-lm
mlx_lm.generate --model Orvena/granite-4.2-3b-MLX-4bit --prompt "Name three Danish cities."
from mlx_lm import load, generate
model, tokenizer = load("Orvena/granite-4.2-3b-MLX-4bit")
print(generate(model, tokenizer, prompt="Name three Danish cities."))
Runs on Apple silicon Macs and recent iPhones. Peak memory during generation is about 2.2 GB.
About
Converted by the Orvena team while evaluating models for fully on-device use. See the base model card for benchmarks, training details, and intended use.
- Task
- Text Generation
- Library
- mlx
- Type
- granite
- License
- apache-2.0
- Created
- Aug 25, 2026
- Updated
- Aug 25, 2026