Downloads · 30 days
13
15% of all-time downloads
genevera/Qwen3.8-27B-Uncensored-Heretic-Abliterated-exl3
Qwen3.8-27B-Uncensored-Heretic-Abliterated-exl3 is a machine learning model from genevera. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This repository contains EXL3 quantizations of alexander2323/Qwen3.8-27B-Uncensored-Heretic-Abliterated at multiple bitrates. Each quantization lives on its own branch.
Downloads · 30 days
13
15% of all-time downloads
All-time downloads
88
Public
Repo size
71.9 GB
Likes
0
Public
Click a slice to open those files.
.md2.8 KB · 97%
From the Hugging Face model README
This repository contains EXL3 quantizations of alexander2323/Qwen3.8-27B-Uncensored-Heretic-Abliterated at multiple bitrates. Each quantization lives on its own branch.
| Branch | Bitrate | Head | Shards | Size (approx.) |
|---|---|---|---|---|
2.00bpw | 2.00 bpw | 4 bpw | 2 | ~13 GB |
3.00bpw | 3.00 bpw | 4 bpw | 2 | ~20 GB |
4.00bpw | 4.00 bpw | 6 bpw | 2 | ~27 GB |
5.00bpw | 5.00 bpw | 6 bpw | 3 | ~33 GB |
6.00bpw | 6.00 bpw | 6 bpw | 3 | ~40 GB |
8.00bpw | 8.00 bpw | 8 bpw | 4 | ~53 GB |
All quantizations were generated with exllamav3 using:
# Clone a specific quantization branch
git clone -b 4.00bpw https://huggingface.co/genevera/Qwen3.8-27B-Uncensored-Heretic-Abliterated-exl3
# Or with git-lfs
git lfs install
git clone https://huggingface.co/genevera/Qwen3.8-27B-Uncensored-Heretic-Abliterated-exl3
cd Qwen3.8-27B-Uncensored-Heretic-Abliterated-exl3
git checkout 4.00bpw
Load with exllamav3:
from exllamav3 import ExLlamaV3
from exllamav3.config import ExLlamaV3Config
config = ExLlamaV3Config()
config.model_dir = "./"
model = ExLlamaV3(config)
alexander2323/Qwen3.8-27B-Uncensored-Heretic-Abliterated — an abliterated + uncensored variant of Qwen3 27B.
Same as the source model. See alexander2323/Qwen3.8-27B-Uncensored-Heretic-Abliterated for details.