Skip to content

zrlu

Huihui-Qwen3.8-27B-abliterated-GPTQ-Int4-sym-G128-MTP-BF16-B70

zrlu/Huihui-Qwen3.8-27B-abliterated-GPTQ-Int4-sym-G128-MTP-BF16-B70

Huihui-Qwen3.8-27B-abliterated-GPTQ-Int4-sym-G128-MTP-BF16-B70 is a text generation model from zrlu. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.

GPTQ-INT4 quantization, purpose-built and tested for single Intel Arc Pro B70 (Xe2, Battlemage) inference via vLLM XPU on Windows Docker Desktop + WSL2 — and for pi/opencode agent workloads on the same card.

Downloads · 30 days

193

18% of all-time downloads

All-time downloads

1.1K

Public

Parameters

27.8B

19.6 GB on disk

Likes

1

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors19.6 GB · 100%

Parameter types

How the weights are stored.

I3224.3B · 88%

Try a prompt

Base models

Task
Text Generation
Library
transformers
Type
qwen3_5
License
apache-2.0
Languages
en, zh
Created
Aug 31, 2026
Updated
Aug 31, 2026