Downloads · 30 days
25
10% of all-time downloads
groxaxo/Qwen3.6-35B-A3B-abliterated-exl3-6bpw
Qwen3.6-35B-A3B-abliterated-exl3-6bpw is a machine learning model from groxaxo. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as other.
Qwen3.6-35B-A3B-abliterated-exl3-6bpw is an EXL3-quantized checkpoint for ExLlamaV3-compatible runtimes, published by groxaxo. It is intended for open-source evaluation, reproducible experimentation, and compatible lo…
Downloads · 30 days
25
10% of all-time downloads
All-time downloads
259
Public
Parameters
13.5B
27 GB on disk
Likes
4
Public
Click a slice to open those files.
.safetensors27 GB · 100%
How the weights are stored.
I1612.9B · 95%
From the Hugging Face model README
Qwen3.6-35B-A3B-abliterated-exl3-6bpw is an EXL3-quantized checkpoint for ExLlamaV3-compatible runtimes, published by groxaxo.
It is intended for open-source evaluation, reproducible experimentation, and compatible local or
hosted inference workflows. The wording below is deliberately limited to what can be verified
from this repository's metadata and artifacts.
The repository name identifies a behavior-modified or reduced-filtering lineage. That label describes the source or conversion history; it is not a guarantee of unrestricted behavior in every prompt or runtime. Test outputs carefully before sharing or deploying them.
| Field | Details |
|---|---|
| Format | EXL3 |
| Source / base | Qwen/Qwen3.6-35B-A3B |
| Intended task | image-text-to-text |
| License | other |
*.safetensors (4 files)config.jsongeneration_config.jsontokenizer.jsontokenizer_config.jsonchat_template.jinjaquantization_config.jsonDownload the EXL3 files and load the desired bitrate with a current ExLlamaV3-compatible runtime. The correct loader and context settings depend on the model architecture and should be verified against the runtime's documentation.
Quantization or conversion changes numerical behavior, memory use, and throughput relative to the source checkpoint; validate quality on your own workload.
Generated outputs may be inaccurate or unsuitable for a given use case. Users are responsible for testing behavior, applying appropriate safeguards, and complying with applicable licenses and laws.
<!-- polished-overview:end -->This is an abliterated (uncensored) version of Qwen/Qwen3.6-35B-A3B, created using Abliterix.
Qwen3.6-35B-A3B is a Mixture-of-Experts model (256 routed experts, 8 active per token, 35B total / 3B active parameters) sharing identical architecture with Qwen3.5-35B-A3B. Standard LoRA-based abliteration is effective on this architecture (unlike Gemma 4's double-norm design which requires direct weight editing).
Key techniques:
| Metric | Value |
|---|---|
| Refusals (LLM judge, 100 eval prompts) | 7/100 |
| KL divergence from base | 0.0189 |
| Baseline refusals (original model) | 100/100 |
| Optimization trials completed | 24/50 |
| LLM judge model | google/gemini-3-flash-preview |
All refusal classifications were performed by an external LLM judge (Google Gemini 3 Flash) — no keyword matching or heuristic detection was used. The judge classifies degenerate/garbled output as refusal, ensuring that only coherent, on-topic, actionable responses count as compliance.
Many abliterated models on HuggingFace claim near-perfect scores ("3/100 refusals", "0.7% refusal rate", etc.). We urge the community to treat these numbers with skepticism unless the evaluation methodology is fully documented.
Through our research, we have identified a systemic problem: most abliteration benchmarks dramatically undercount refusals due to:
test_trial.py to confirm coherent, on-topic output before export.We report 7/100 refusals honestly. This is a real number from a rigorous, LLM-judge-based evaluation — not an optimistic estimate from a lenient pipeline.
from transformers import AutoModelForCausalLM, AutoTokenizer
import torch
model = AutoModelForCausalLM.from_pretrained(
"wangzhang/Qwen3.6-35B-A3B-abliterated",
torch_dtype=torch.bfloat16,
device_map="auto",
)
tokenizer = AutoTokenizer.from_pretrained("wangzhang/Qwen3.6-35B-A3B-abliterated")
messages = [{"role": "user", "content": "Your prompt here"}]
text = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True, enable_thinking=False)
inputs = tokenizer(text, return_tensors="pt").to(model.device)
with torch.no_grad():
output = model.generate(**inputs, max_new_tokens=512)
print(tokenizer.decode(output[0][inputs["input_ids"].shape[1]:], skip_special_tokens=True))
This model is released for research purposes only. The abliteration process removes safety guardrails — use responsibly.