Downloads · 30 days
84
3% of all-time downloads
gemma-4-31B-it-uncensored-GGUF
lactroiii/gemma-4-31B-it-uncensored-GGUF
gemma-4-31B-it-uncensored-GGUF is a text generation model from lactroiii. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
GGUF quantizations of TrevorJS/gemma-4-31B-it-uncensored.
All-time downloads
2.5K
Public
Repo size
51.3 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf51.3 GB · 100%
At a glance
- Task
- Text Generation
- License
- apache-2.0
- Access
- Public
- Created
- Apr 5, 2026
- Updated
- Apr 5, 2026
- SHA
- e0fe4430
Try a prompt
Base models
Model card
From the Hugging Face model README
gemma-4-31B-it-uncensored (GGUF)
GGUF quantizations of TrevorJS/gemma-4-31B-it-uncensored.
Files
| File | Quant | Size |
|---|---|---|
gemma-4-31B-it-uncensored-Q4_K_M.gguf | Q4_K_M | 18.7 GB |
gemma-4-31B-it-uncensored-Q8_0.gguf | Q8_0 | 32.6 GB |
Usage
# From HuggingFace (auto-downloads)
llama-server -hf TrevorJS/gemma-4-31B-it-uncensored-GGUF -c 8192
# From local file
llama-server -m gemma-4-31B-it-uncensored-Q4_K_M.gguf -c 8192
Then open http://localhost:8080 for the chat UI.
Details
These are GGUF quantizations of TrevorJS/gemma-4-31B-it-uncensored, an abliterated (uncensored) version of google/gemma-4-31B-it. Refusal behavior has been removed using norm-preserving biprojected abliteration.
See the bf16 model card for full method details, before/after refusal rates, and cross-dataset validation results.
Source code: TrevorJS/gemma-4-abliteration
- Task
- Text Generation
- License
- apache-2.0
- Languages
- en
- Created
- Apr 5, 2026
- Updated
- Apr 5, 2026