Downloads · 30 days
97
9% of all-time downloads
jakeatx/Qwen3.8-27B-Ternary-PTQ1_0-MTP-GGUF
Qwen3.8-27B-Ternary-PTQ1_0-MTP-GGUF is a machine learning model from jakeatx. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Ternary (1.75 bpw) quantization of Qwen3.8-27B (Prism ML Ternary Bonsai 2 architecture) with native 1-layer MTP speculative drafting.
Downloads · 30 days
97
9% of all-time downloads
All-time downloads
1K
Public
Repo size
6.2 GB
Likes
0
Public
Click a slice to open those files.
.gguf6.2 GB · 100%
From the Hugging Face model README
Ternary (1.75 bpw) quantization of Qwen3.8-27B (Prism ML Ternary Bonsai 2 architecture) with native 1-layer MTP speculative drafting.
PTQ1_0 (group 128, 28 bytes/block, ~1.75 bpw)feature/v0.3.1-bonsai2)./build-sm86/bin/llama-server \
-m Qwen3.8-27B-Ternary-PTQ1_0-MTP.gguf \
-c 32768 -b 4096 -ub 1024 -t 8 -ngl 99 -fa on -ctk q8_0 -ctv turbo3 \
--spec-type draft-mtp --spec-draft-n-max 3 --spec-draft-p-min 0