Downloads · 30 days
255
6% of all-time downloads
NjProVk/Ornith-1.5-35B-A3B-abliterated-GGUF
Ornith-1.5-35B-A3B-abliterated-GGUF is a text generation model from NjProVk. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
This repository provides GGUF quantizations of the uncensored (abliterated) version of Ornith-1.5-35B-A3B.
Downloads · 30 days
255
6% of all-time downloads
All-time downloads
4.1K
Public
Repo size
292 GB
Likes
3
Public
Click a slice to open those files.
.gguf181 GB · 100%
From the Hugging Face model README
This repository provides GGUF quantizations of the uncensored (abliterated) version of Ornith-1.5-35B-A3B.
Safety guardrails and refusal mechanisms have been surgically neutralized across the Mixture-of-Experts (MoE) layers while preserving the base model's full capabilities, reasoning quality, and expert routing.
| File | Quant | Size / RAM | Description |
|---|---|---|---|
Ornith-1.5-35B-A3B-abliterated-Q4_K_M.gguf | Q4_K_M | Recommended | Best balance between memory usage, speed, and quality. |
Ornith-1.5-35B-A3B-abliterated-Q5_K_M.gguf | Q5_K_M | Medium-High | Higher quality, minimal perplexity degradation. |
Ornith-1.5-35B-A3B-abliterated-Q6_K.gguf | Q6_K | High | Near-lossless output quality. |
Ornith-1.5-35B-A3B-abliterated-Q8_0.gguf | Q8_0 | Very High | Full 8-bit precision, closest to 16-bit original. |
Make sure you are using a recent version of llama.cpp:
llama-cli \
-m Ornith-1.5-35B-A3B-abliterated-Q4_K_M.gguf \
-p "You are a helpful assistant." \
-c 32768 \
-ngl 99 \
--temp 0.7
NjProVk/Ornith-1.5-35B-A3B-abliterated-GGUF0.6 – 0.8 (Lower for coding/logic, higher for creative roleplay/writing)0.9 – 0.950.05