Downloads · 30 days
99
6% of all-time downloads
symrex/Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic-NM-DAU-NEO-MAX-MTP-GGUF-dequantized-oQ8e-mtp
Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic-NM-DAU-NEO-MAX-MTP-GGUF-dequantized-oQ8e-mtp is a machine learning model from symrex. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for mlx.
This model was quantized using oQ (oMLX v0.5.7) mixed-precision quantization.
Downloads · 30 days
99
6% of all-time downloads
All-time downloads
1.6K
Public
Parameters
27.8B
30 GB on disk
Likes
2
Public
Click a slice to open those files.
.safetensors30 GB · 100%
How the weights are stored.
U3227.3B · 98%
From the Hugging Face model README
This model was quantized using oQ (oMLX v0.5.7) mixed-precision quantization.
oMLX - LLM inference, optimized for your Mac
https://github.com/jundot/omlx
Benchmark Model: Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic-NM-DAU-NEO-MAX-MTP-GGUF-dequantized-oQ8e-mtp
Engine: Auto
Context: Code (Python)
================================================================================
Single Request Results
--------------------------------------------------------------------------------
Test TTFT(ms) TPOT(ms) pp TPS tg TPS E2E(s) Throughput Peak Mem
pp1024/tg128 4127.9 61.57 248.1 tok/s 16.4 tok/s 11.960 96.3 tok/s 28.34 GB
pp4096/tg128 16366.9 62.22 250.3 tok/s 16.2 tok/s 24.279 174.0 tok/s 29.93 GB
pp8192/tg128 33175.4 63.21 246.9 tok/s 15.9 tok/s 41.217 201.9 tok/s 30.84 GB
pp16384/tg128 68451.5 64.77 239.4 tok/s 15.6 tok/s 76.691 215.3 tok/s 32.67 GB
pp32768/tg128 145258.7 67.43 225.6 tok/s 14.9 tok/s 153.836 213.8 tok/s 36.32 GB
pp65536/tg128 326820.5 73.41 200.5 tok/s 13.7 tok/s 336.158 195.3 tok/s 43.64 GB
pp131072/tg128 812699.7 84.11 161.3 tok/s 12.0 tok/s 823.399 159.3 tok/s 58.61 GB
Continuous Batching
pp1024 / tg128
--------------------------------------------------------------------------------
Batch tg TPS Speedup pp TPS pp TPS/req TTFT(ms) E2E(s)
1x 16.4 tok/s 1.00x 248.1 tok/s 248.1 tok/s 4127.9 11.960
2x 31.7 tok/s 1.93x 191.1 tok/s 95.5 tok/s 10717.1 18.802
4x 60.0 tok/s 3.66x 242.7 tok/s 60.7 tok/s 16691.4 25.414
8x 75.9 tok/s 4.63x 241.7 tok/s 30.2 tok/s 33204.9 47.391
Intelligence Benchmark Comparison
--- Detail ---
Model: Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic-NM-DAU-NEO-MAX-MTP-GGUF-dequantized-oQ8e-mtp
Benchmark Accuracy Correct Total Time(s) Think
--------------------------------------------------------------
MMLU 91.5% 915 1000 29025.1 Yes
TRUTHFULQA 90.0% 735 817 27397 Yes
HUMANEVAL 92.1% 151 164 10308.3 Yes