Downloads · 30 days
32
10% of all-time downloads
matvei-aleksandrovich/Qwen3.8-27B-MLX-4bit
Qwen3.8-27B-MLX-4bit is a image-text-to-text model from matvei-aleksandrovich. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for mlx. The card lists the license as apache-2.0.
This is a 4-bit affine MLX conversion of Qwen/Qwen3.8-27B for Apple silicon. The original tokenizer, chat template, and image/video processor files are included.
Downloads · 30 days
32
10% of all-time downloads
All-time downloads
307
Public
Parameters
27.4B
16.1 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors16.1 GB · 100%
How the weights are stored.
U3226.9B · 98%
From the Hugging Face model README
This is a 4-bit affine MLX conversion of
Qwen/Qwen3.8-27B for Apple
silicon. The original tokenizer, chat template, and image/video processor
files are included.
qwen3_5 / Qwen3_5ForConditionalGenerationerokhins/mlx-vlm, commit 77f16c25python -m mlx_vlm.generate \
--model matvei-aleksandrovich/Qwen3.8-27B-MLX-4bit \
--prompt "Explain linear attention in simple terms." \
--max-tokens 256
For speculative decoding, use the matching
Qwen3.8-27B-MTP-4bit
drafter. A drafter from another Qwen version is not a supported substitute.
mlx_vlm.convert \
--hf-path Qwen/Qwen3.8-27B \
--mlx-path ./Qwen3.8-27B-MLX-4bit \
--quantize --q-bits 4
This community conversion is not an official Qwen release. Validate quality, performance, and memory use on your own workload.