Downloads · 30 days
30
7% of all-time downloads
SGLabs/Qwen3.8-27B-Pym-IQ2_XXS-GGUF
Qwen3.8-27B-Pym-IQ2_XXS-GGUF is a text generation model from SGLabs. Use it when you need the model to write or continue text. It is set up for llama.cpp. The card lists the license as apache-2.0.
A ~16 GB imatrix-calibrated, mixed-precision GGUF of Qwen3.8-27B (a qwen35 hybrid SSM+attention architecture) — SGLabs' first dense-model Pym quant.
Downloads · 30 days
30
7% of all-time downloads
All-time downloads
461
Public
Repo size
16 GB
Likes
0
Public
Click a slice to open those files.
.gguf16 GB · 100%
From the Hugging Face model README
A ~16 GB imatrix-calibrated, mixed-precision GGUF of Qwen3.8-27B (a qwen35 hybrid
SSM+attention architecture) — SGLabs' first dense-model Pym quant.
Base model: Qwen/Qwen3.8-27B — a multimodal
(image-text-to-text), 27B dense model with 256K context, agentic-coding and reasoning
strengths, and a native MTP head.
This quant: dense FFN to 2–3 bits; attention, SSM, norms, embeddings, and the MTP head preserved at Q8 (so speculative decoding stays on). Runs on llama.cpp — AMD (ROCm) and Apple Silicon. No CUDA required.
ffn_gate, ffn_up → IQ2_XXSffn_down → IQ3_XXS# with MTP speculative decoding (recommended):
llama-server -m Qwen3.8-27B-Pym-IQ2_XXS.gguf -ngl 999 -c 32768 \
--spec-type draft-mtp --spec-draft-n-max 2 -np 1
| File | Qwen3.8-27B-Pym-IQ2_XXS.gguf |
| Size | 15.99 GB (14.9 GiB) · 4.68 BPW |
| Architecture | qwen35 · 65 blocks (64 + MTP) |
Mixed-precision quant: the filename carries the dominant standard token (IQ2_XXS) for
general compatibility; loaders requiring a uniform general.file_type may report it as custom.
Quantized by SGLabs.