Downloads · 30 days
92
7% of all-time downloads
mensaprodigy/Qwen3.8-27B-oQ6e-mtp-mlx
Qwen3.8-27B-oQ6e-mtp-mlx is a text generation model from mensaprodigy. Use it when you need the model to write or continue text. It is set up for mlx. The card lists the license as apache-2.0.
This repository contains an Apple Silicon / MLX quantization of Qwen/Qwen3.8-27B.
Downloads · 30 days
92
7% of all-time downloads
All-time downloads
1.4K
Public
Parameters
27.8B
23.7 GB on disk
Likes
2
Public
Click a slice to open those files.
.safetensors23.7 GB · 100%
How the weights are stored.
U3227.3B · 98%
From the Hugging Face model README
This repository contains an Apple Silicon / MLX quantization of Qwen/Qwen3.8-27B.
It is a community conversion, not an official Qwen release. The original model, model behavior, and upstream documentation belong to Qwen / Alibaba Cloud. This repository packages quantized weights and compatible metadata for local MLX inference.
Qwen/Qwen3.8-27Boqe_code_multilingual
mtp_num_hidden_layers: 1).qwen3_5 multimodal architecture with image and video token support.This package includes the Qwen Sharp Chat Template v22 from peculiar-ragdoll/Qwen-Sharp-Chat-Templates.
The template is installed in both locations used by common MLX/OpenAI-compatible runtimes:
chat_template.jinjatokenizer_config.json → chat_templateIt preserves Qwen vision placeholders and tool-call formatting while adding direct-answer guidance and configurable thinking controls. The bundled template version marker is:
qwen3.8-froggeric-v22
This artifact was loaded successfully with oMLX on Apple Silicon and served through its OpenAI-compatible chat-completions endpoint.
After placing the repository in your oMLX model directory, select this exact model ID:
Qwen3.8-27B-oQ6e-mtp
Example request shape:
{
"model": "Qwen3.8-27B-oQ6e-mtp",
"messages": [
{"role": "user", "content": "Explain the difference between a cache and a database."}
]
}
preserve_thinking behavior; retaining reasoning history can increase prefill cost.Please retain upstream attribution and include the applicable Apache-2.0 license and notices when redistributing this derivative.
The upstream Qwen3.8-27B release is licensed under Apache-2.0. This repository is distributed under the same license, subject to the upstream license terms and required attribution/notices.
Thanks to Qwen / Alibaba Cloud for the original model release, the MLX ecosystem for Apple Silicon inference tooling, and the Qwen Sharp template maintainers for the compatible conversation template.