Downloads · 30 days
33
15% of all-time downloads
falcon-h1-1.5b-mlx-4bit
sdkv2/falcon-h1-1.5b-mlx-4bit
falcon-h1-1.5b-mlx-4bit is a text generation model from sdkv2. Use it when you need the model to write or continue text. It is set up for mlx.
4-bit quantized MLX port of tiiuae/Falcon-H1-1.5B-Base for Apple Silicon.
All-time downloads
214
Public
Parameters
1.6B
876 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors876 MB · 99%
Parameter types
How the weights are stored.
U321.6B · 100%
Try a prompt
Model card
From the Hugging Face model README
Falcon-H1 1.5B MLX 4-bit
4-bit quantized MLX port of tiiuae/Falcon-H1-1.5B-Base for Apple Silicon.
For BF16: sdkv2/falcon-h1-1.5b-mlx-bf16
Usage
from mlx_lm import load, generate
model, tokenizer = load("sdkv2/falcon-h1-1.5b-mlx-4bit")
response = generate(model, tokenizer, prompt="Hello", verbose=True)
- Task
- Text Generation
- Library
- mlx
- Type
- falcon_h1
- Languages
- en
- Created
- Aug 29, 2026
- Updated
- Aug 30, 2026