Downloads · 30 days
0
qwen35-mlx-demo
yourlittledialecticalboo/qwen35-mlx-demo
qwen35-mlx-demo is a machine learning model from yourlittledialecticalboo. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
A static demo page for the quantized MLX version of Qwen3.5-0.8B, optimized for Apple Silicon.
Access
Public
Updated Sep 12, 2026
Repo size
—
Likes
0
Public
Repo makeup
Click a slice to open those files.
.html7.4 KB · 73%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Sep 12, 2026
- Updated
- Sep 12, 2026
- SHA
- 01dfaee6
Model card
From the Hugging Face model README
Qwen3.5-0.8B-MLX-8bit Demo
A static demo page for the quantized MLX version of Qwen3.5-0.8B, optimized for Apple Silicon.
Model Details
- Original Model: Qwen/Qwen3.5-0.8B
- Quantization: 8-bit (~9.389 bits per weight)
- Group Size: 64
- Format: MLX SafeTensors
- Framework: mlx-vlm
- Disk Size: ~980 MB
- License: Apache 2.0
Quick Start
pip install mlx-vlm
pip install huggingface_hub[hf_xet]
huggingface-cli download --local-dir Qwen3.5-0.8B-MLX-8bit \
mlx-community/Qwen3.5-0.8B-MLX-8bit
mlx_vlm generate \
--model mlx-community/Qwen3.5-0.8B-MLX-8bit \
--prompt "Hello, how are you?" \
--max-tokens 200
Python Usage
from mlx_vlm import load, generate
model, processor = load("mlx-community/Qwen3.5-0.8B-MLX-8bit")
output = generate(
model,
processor,
prompt="Describe this image in detail",
image="path/to/image.jpg",
max_tokens=200
)
print(output)
- License
- apache-2.0
- Created
- Sep 12, 2026
- Updated
- Sep 12, 2026