Skip to content

sheppo

Qwen3.8-27B-Heretic-Abliterated-W4A16-A100

sheppo/Qwen3.8-27B-Heretic-Abliterated-W4A16-A100

Qwen3.8-27B-Heretic-Abliterated-W4A16-A100 is a text generation model from sheppo. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.

W4A16 AutoRound checkpoint derived from the exact RVN BF16 GGUF and tested on one A100-SXM4-80GB. It measured 73.15 tok/s raw and 138.38 tok/s with the companion DFlash2 runtime on the frozen sampled-prose benchmark,…

Downloads · 30 days

150

14% of all-time downloads

All-time downloads

1K

Public

Parameters

5.8B

17.7 GB on disk

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors17.7 GB · 100%

Parameter types

How the weights are stored.

I3224.3B · 90%

Try a prompt

Base models

Task
Text Generation
Library
transformers
Type
qwen3_5_text
License
apache-2.0
Created
Aug 25, 2026
Updated
Aug 26, 2026