Downloads · 30 days
926
27% of all-time downloads
itrejomx/Qwen3.8-27B-Uncensored-HauhauCS-Aggressive-MTPLX-6bit
Qwen3.8-27B-Uncensored-HauhauCS-Aggressive-MTPLX-6bit is a machine learning model from itrejomx. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for mlx. The card lists the license as apache-2.0.
MLX 6-bit build of HauhauCS's Qwen3.8-27B Uncensored Aggressive fine-tune with a working multi-token-prediction (MTP) head, forged and verified with MTPLX (contract=true).
Downloads · 30 days
926
27% of all-time downloads
All-time downloads
3.4K
Public
Parameters
26.9B
22.7 GB on disk
Likes
1
Public
Click a slice to open those files.
.safetensors22.7 GB · 100%
How the weights are stored.
U3226.9B · 100%
From the Hugging Face model README
MLX 6-bit build of HauhauCS's Qwen3.8-27B Uncensored Aggressive fine-tune with a working multi-token-prediction (MTP) head, forged and verified with MTPLX (contract=true).
As far as I know this is the first MLX conversion of this fine-tune — the author publishes GGUF only.
| Mode | decode tok/s | vs AR |
|---|---|---|
| Autoregressive | 10.9 | 1.00x |
| MTP depth 1 | 23.9 | 2.20x |
| MTP depth 2 | 30.9 | 2.84x |
| MTP depth 3 | 25.8 | 2.38x |
MTPLX auto-tunes the depth per machine; on the build machine depth 2 was selected. For comparison, the same fine-tune as Q6 GGUF with the FastMTP sidecar in llama.cpp reached ~12.5 tok/s on the same hardware.
mtplx pull <this-repo>
mtplx tune --model <this-repo> --retune # calibrate MTP depth for your machine
This is a community conversion, not an official HauhauCS release (their releases carry Ed25519-signed manifests; this one does not).
mtp_policy: keep_bf16) and was verified against the trunk by MTPLX Forge.A_log as -exp(A_log); both transforms were inverted to restore the HF/MLX layout before forging.enable_thinking: true to turn it back on. This avoids greedy-decoding degeneration loops and matches how most people run this model for direct tasks.<think>/</think> special-token registration, which the GGUF metadata round-trip loses. Text encoding is byte-identical to the original.