Downloads · 30 days
415
15% of all-time downloads
Carlosian/Qwen3.5-35B-A3B-Abliterated-GGUF
Qwen3.5-35B-A3B-Abliterated-GGUF is a text generation model from Carlosian. Use it when you need the model to write or continue text. It is set up for gguf. The card lists the license as other.
Quantized GGUF builds of Carlosian/Qwen3.5-35B-A3B-Abliterated for llama.cpp / Ollama / LM Studio.
Downloads · 30 days
415
15% of all-time downloads
All-time downloads
2.8K
Public
Repo size
220 GB
Likes
0
Public
Click a slice to open those files.
.gguf220 GB · 100%
From the Hugging Face model README
Quantized GGUF builds of Carlosian/Qwen3.5-35B-A3B-Abliterated for llama.cpp / Ollama / LM Studio.
| Quant | Typical use |
|---|---|
| Q2_K | smallest / extreme low VRAM |
| Q3_K_S / Q3_K_M | low VRAM |
| Q4_0 / Q4_K_S / Q4_K_M | recommended default (Q4_K_M) |
| Q5_K_S / Q5_K_M | higher quality |
| Q6_K | near-lossless |
| Q8_0 | highest quality quant |
Built with llama.cpp on Thunder Compute (A100). Generated 2026-07-20. Uploaded incrementally per-quant to manage disk (35B MoE ladder is large).