Downloads · 30 days
43
18% of all-time downloads
gemma-4-E4B-it-Q5_K_M
tatvaAi/gemma-4-E4B-it-Q5_K_M
gemma-4-E4B-it-Q5_K_M is a text generation model from tatvaAi. Use it when you need the model to write or continue text. The card lists the license as other.
All-time downloads
240
Public
Repo size
5.8 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf5.8 GB · 100%
At a glance
- Task
- Text Generation
- License
- other
- Access
- Public
- Created
- Apr 11, 2026
- Updated
- Apr 14, 2026
- SHA
- 528786f6
Try a prompt
Model card
From the Hugging Face model README
Gemma 4 E4B IT – GGUF (Q5_K_M)
🔷 Model Overview
This repository contains a GGUF Q5_K_M conversion of:
- Base Model: gemma-4-e4b-it
- Developer: Google
- Format: GGUF (optimized for llama.cpp)
- Precision: Q5_K_M
This model is designed for high-quality local inference.
📦 Files
| File | Description |
|---|---|
gemma-4-e4b-it-Q5_K_M.gguf | Q5_K_M GGUF model |
⚙️ Technical Details
| Parameter | Value |
|---|---|
| Architecture | gemma-4-e4b-it |
| Format | GGUF |
| Precision | Q5_K_M |
| Runtime | llama.cpp |
| Use Case | High-quality inference |
⚡ Why GGUF?
GGUF enables:
- Efficient CPU inference via llama.cpp
- Single-file model distribution
- Fast loading using memory mapping
- Cross-platform compatibility
⚠️ License & Usage
This is a converted derivative model.
You must comply with the original license:
👉 https://huggingface.co/google/gemma-4-e4b-it
Important:
- ❌ Not an official Google release
- ❌ No additional rights granted
- ✅ Original model ownership remains with Google
- ⚠️ Use responsibly under original license terms
🚀 Quick Start (llama.cpp)
./llama-cli -m gemma-4-e4b-it-Q5_K_M.gguf -p "Explain AI simply"
- Task
- Text Generation
- License
- other
- Created
- Apr 11, 2026
- Updated
- Apr 14, 2026