gemma-4-E2B-it-IQ4_NL

gemma-4-E2B-it — GGUF (IQ4_NL)

---

📊 Performance Metrics

• Size: 3.14 GB
• Speed: 6.50 tokens/sec
• Format: GGUF (llama.cpp optimized)
• Quantization: IQ4_NL

---

🔷 Model Overview

This repository contains a GGUF quantized version of:

• Base Model: gemma-4-E2B-it
• Format: GGUF (optimized for llama.cpp inference)
• Precision: IQ4_NL
• Purpose: Efficient local inference on CPU/GPU

GGUF format provides:

• Fast loading via memory mapping
• Single-file model distribution
• Cross-platform compatibility
• Efficient inference with llama.cpp

---

📦 Files

---

⚙️ Technical Details

---

⚡ Why GGUF?

GGUF is designed for efficient inference:

• Optimized for llama.cpp
• Supports CPU and GPU inference
• Single-file deployment
• Memory-mapped loading for speed
• Ideal for edge / local environments

---

⚠️ License & Usage

This is a converted derivative model.

• You must comply with the original model license of gemma-4-E2B-it
• This is not an official release
• No additional rights are granted
• Original ownership remains with the base model creator

---

🚀 Quick Start (llama.cpp)

./llama-cli -m gemma-4-E2B-it-IQ4_NL.gguf -p "Explain AI simply"