Downloads · 30 days
28
3% of all-time downloads
nightmedia/Qwen3.6-35B-A3B-Fable-5-Distill-qx86-hi-mlx
Qwen3.6-35B-A3B-Fable-5-Distill-qx86-hi-mlx is a image-text-to-text model from nightmedia. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for transformers.
Downloads · 30 days
28
3% of all-time downloads
All-time downloads
873
Public
Parameters
35.1B
39.5 GB on disk
Likes
1
Public
Click a slice to open those files.
.safetensors39.5 GB · 100%
How the weights are stored.
U3234.7B · 99%
From the Hugging Face model README
Brainwaves
arc arc/e boolq hswag obkqa piqa wino
qx86-hi 0.635,0.821,0.891
Quant Perplexity Peak Memory Tokens/sec
qx86-hi 4.489 ± 0.029 45.50 GB 1448
Qwen3.6-35B-A3B
arc arc/e boolq hswag obkqa piqa wino
mxfp8 0.581,0.757,0.892,0.751,0.428,0.803,0.688
qx86-hi 0.576,0.742,0.896,0.745,0.422,0.803,0.708
qx64-hi 0.589,0.763,0.892,0.748,0.428,0.801,0.700
mxfp4 0.586,0.767,0.886,0.751,0.428,0.798,0.681
This model quant is using(an early version of) the fixed jinja template from froggeric/Qwen-Fixed-Chat-Templates
Drop <|think_on|> or <|think_off|> anywhere in your system or user prompt. The template intercepts the tag, removes it from context so the model never sees it, and flips the mode.
I added: <|think_forget|> / <|think_remember|> if you want to exclude thinking content out of the context (experimental).
More metrics coming soon.
-G
pip install mlx-lm
from mlx_lm import load, generate
model, tokenizer = load("Qwen3.6-35B-A3B-Fable-5-Distill-qx86-hi-mlx")
prompt = "hello"
if tokenizer.chat_template is not None:
messages = [{"role": "user", "content": prompt}]
prompt = tokenizer.apply_chat_template(
messages, add_generation_prompt=True, return_dict=False,
)
response = generate(model, tokenizer, prompt=prompt, verbose=True)