Downloads · 30 days
430
24% of all-time downloads
NLLM-ai/gemma-4-E2B-uncensored-slim-GGUF
gemma-4-E2B-uncensored-slim-GGUF is a text generation model from NLLM-ai. Use it when you need the model to write or continue text. The card lists the license as gemma.
A compact Q4KM requantized GGUF build of a Gemma-based "uncensored slim" derivative, prepared primarily for efficient on-device inference.
Downloads · 30 days
430
24% of all-time downloads
All-time downloads
1.8K
Public
Repo size
2.7 GB
Likes
0
Public
Click a slice to open those files.
.gguf2.7 GB · 100%
From the Hugging Face model README
A compact Q4_K_M requantized GGUF build of a Gemma-based "uncensored slim" derivative, prepared primarily for efficient on-device inference.
This release is focused on Android, mobile-class hardware and
llama.cpp compatible runtimes.
The model can run fully locally:
It is used experimentally with NLLM, an Android-oriented local LLM runtime built around llama.cpp.
On mobile devices, memory footprint and memory bandwidth are often the main bottlenecks.
Q4_K_M reduces model weight precision to approximately 4-bit while retaining higher precision for selected tensors where additional accuracy is useful.
The goal of this requantized build is to provide a practical balance between:
This makes the model considerably easier to deploy on constrained hardware than a higher-precision checkpoint.
| Field | Value |
|---|---|
| File | gemma-4-E2B-uncensored-slim-Q4_K_M.gguf |
| Quantization | Q4_K_M |
| Size | ~2.72 GB |
| Format | GGUF |
| SHA256 | adce3282cb2e87c1f878a92f9e55d9c0ba9f40fda7367dc535aabff13b6be31b |
llama-cli \
-m gemma-4-E2B-uncensored-slim-Q4_K_M.gguf \
-ngl 0 \
-c 2048 \
-p "Merhaba, nasilsin?"
llama-server \
-m gemma-4-E2B-uncensored-slim-Q4_K_M.gguf \
-c 4096 \
--port 8080
Download the GGUF file to the device and select it as the active model inside NLLM.
The native inference layer uses an arm64-v8a build of llama.cpp.
| Field | Result |
|---|---|
| Device | TECNO KM8n (arm64-v8a) |
| Architecture | arm64-v8a |
| Approx. model RAM requirement | ~3 GB |
| Suggested system RAM | 4 GB minimum |
| Measured CPU inference | ~5 token/s |
Performance varies significantly depending on CPU architecture, memory bandwidth, thermal limits, context length and background load.
The measurement above refers to CPU inference without GPU acceleration.
This repository is primarily about deployment optimization, not language fine-tuning.
The model has been prepared as a smaller Q4_K_M GGUF build so it can be used more comfortably on mobile and local devices.
Turkish capability comes from the underlying model rather than from a dedicated Turkish fine-tuning stage.
Suitable for experimentation with:
This model is Gemma-based.
Use is subject to the Gemma Terms of Use and Gemma Prohibited Use Policy.
Users are responsible for complying with the applicable Gemma terms.
Q4_K_M requantization of a Gemma-based "uncensored slim" derivative, prepared for efficient fully on-device inference on Android and other resource-constrained systems through llama.cpp.
This is not a Turkish fine-tune. Its Turkish capability comes from the underlying model; this repository focuses on reducing deployment footprint and making local mobile inference practical.