Downloads · 30 days
93
8% of all-time downloads
gemma-4-E2B-it-uncensored-GGUF
mathu59/gemma-4-E2B-it-uncensored-GGUF
gemma-4-E2B-it-uncensored-GGUF is a text generation model from mathu59. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
GGUF quantizations of TrevorJS/gemma-4-E2B-it-uncensored.
All-time downloads
1.2K
Public
Repo size
8.4 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf8.4 GB · 100%
At a glance
- Task
- Text Generation
- License
- apache-2.0
- Access
- Public
- Created
- Apr 22, 2026
- Updated
- Apr 22, 2026
- SHA
- dfb6b6e6
Try a prompt
Base models
Model card
From the Hugging Face model README
gemma-4-E2B-it-uncensored (GGUF)
GGUF quantizations of TrevorJS/gemma-4-E2B-it-uncensored.
Files
| File | Quant | Size |
|---|---|---|
gemma-4-E2B-it-uncensored-Q4_K_M.gguf | Q4_K_M | 3.4 GB |
gemma-4-E2B-it-uncensored-Q8_0.gguf | Q8_0 | 5.0 GB |
Usage
# From HuggingFace (auto-downloads)
llama-server -hf TrevorJS/gemma-4-E2B-it-uncensored-GGUF -c 8192
# From local file
llama-server -m gemma-4-E2B-it-uncensored-Q4_K_M.gguf -c 8192
Then open http://localhost:8080 for the chat UI.
Details
These are GGUF quantizations of TrevorJS/gemma-4-E2B-it-uncensored, an abliterated (uncensored) version of google/gemma-4-E2B-it. Refusal behavior has been removed using norm-preserving biprojected abliteration.
See the bf16 model card for full method details, before/after refusal rates, and cross-dataset validation results.
Source code: TrevorJS/gemma-4-abliteration
- Task
- Text Generation
- License
- apache-2.0
- Languages
- en
- Created
- Apr 22, 2026
- Updated
- Apr 22, 2026