Downloads · 30 days
25
3% of all-time downloads
sdkv2/falcon-h1-1.5b-mlx-bf16
falcon-h1-1.5b-mlx-bf16 is a text generation model from sdkv2. Use it when you need the model to write or continue text. It is set up for mlx.
MLX port of tiiuae/Falcon-H1-1.5B-Base for Apple Silicon.
Downloads · 30 days
25
3% of all-time downloads
All-time downloads
743
Public
Parameters
1.6B
3.1 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors3.1 GB · 100%
From the Hugging Face model README
MLX port of tiiuae/Falcon-H1-1.5B-Base for Apple Silicon.
For 4-bit: sdkv2/falcon-h1-1.5b-mlx-4bit
from mlx_lm import load, generate
model, tokenizer = load("sdkv2/falcon-h1-1.5b-mlx-bf16")
response = generate(model, tokenizer, prompt="Hello", verbose=True)