Downloads · 30 days
30
6% of all-time downloads
darthcrawl/skyfall-31b-v4.2-mlx-4bit
skyfall-31b-v4.2-mlx-4bit is a machine learning model from darthcrawl. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for mlx. The card lists the license as apache-2.0.
4-bit MLX quantization of TheDrummer/Skyfall-31B-v4.2, produced with mlxlm.convert. Apple Silicon only.
Downloads · 30 days
30
6% of all-time downloads
All-time downloads
521
Public
Parameters
31.4B
17.7 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors17.6 GB · 100%
How the weights are stored.
U3231.4B · 100%
From the Hugging Face model README
4-bit MLX quantization of TheDrummer/Skyfall-31B-v4.2, produced with mlx_lm.convert. Apple Silicon only.
pip install -U mlx-lm
mlx_lm.generate \
--model darthcrawl/skyfall-31b-v4.2-mlx-4bit \
--prompt "Continue this scene: a private investigator returns to her office at 2 AM and finds the door already unlocked."
Or from Python:
from mlx_lm import load, generate
model, tok = load("darthcrawl/skyfall-31b-v4.2-mlx-4bit")
print(generate(model, tok, "Continue this scene: ...", max_tokens=512))
| Repo | Bits | Approx Size |
|---|---|---|
| ...mlx-4bit | 4 | ~17 GB |
| ...mlx-6bit | 6 | ~25 GB |
| ...mlx-8bit | 8 | ~33 GB |
Apache 2.0, inherited from the base.