Downloads · 30 days
42
12% of all-time downloads
nightmedia/Gemma-4-E4B-it-Fable-Distill-q8-hi-mlx
Gemma-4-E4B-it-Fable-Distill-q8-hi-mlx is a image-text-to-text model from nightmedia. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for mlx. The card lists the license as apache-2.0.
Downloads · 30 days
42
12% of all-time downloads
All-time downloads
343
Public
Parameters
7.9B
9.4 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors9.3 GB · 100%
How the weights are stored.
U327.5B · 94%
From the Hugging Face model README
Brainwaves
arc arc/e boolq hswag obkqa piqa wino
q8-hi 0.550,0.744,0.818,0.700,0.458,0.780,0.699
gemma-4-E4B-it
arc arc/e boolq hswag obkqa piqa wino
bf16 0.490,0.674,0.793,0.612,0.416,0.756,0.669
mxfp8 0.480,0.656,0.797,0.608,0.400,0.755,0.665
This model Gemma-4-E4B-it-Fable-Distill-q8-hi-mlx was converted to MLX format from armand0e/Gemma-4-E4B-it-Fable-Distill using mlx-lm version 0.31.3.
pip install mlx-lm
from mlx_lm import load, generate
model, tokenizer = load("Gemma-4-E4B-it-Fable-Distill-q8-hi-mlx")
prompt = "hello"
if tokenizer.chat_template is not None:
messages = [{"role": "user", "content": prompt}]
prompt = tokenizer.apply_chat_template(
messages, add_generation_prompt=True, return_dict=False,
)
response = generate(model, tokenizer, prompt=prompt, verbose=True)