gemma-4-E4B-Agentic-Opus-Reasoning-GeminiCLI-GGUF

<div align="center">

Gemma 4 E4B — Opus Reasoning + Claude Code | GGUF

GGUF version of our Opus 4.6 reasoning model. Ollama ✅ LM Studio ✅ llama.cpp ✅ Reasoning baked in — no adapter needed.

Built by RavenX AI · GGUF converted from MLX source

</div>

---

What is this?

This is the GGUF version of gemma-4-E4B-Agentic-Opus-Reasoning-GeminiCLI-mlx-4bit — Gemma 4 E4B with Opus 4.6 reasoning and Claude Code LoRA fused directly into the weights.

No adapter needed, no extra config — just load and run with Claude-style <think> reasoning baked in.

Looking for the Apple Silicon MLX version? → MLX 4-bit model (optimized for Metal GPU)

---

Available Quantizations

Sizes will be updated once conversion is complete.

---

🦙 Ollama — One Command

ollama run hf.co/deadbydawn101/gemma-4-E4B-Agentic-Opus-Reasoning-GeminiCLI-GGUF

With a custom system prompt

Create a Modelfile:

FROM hf.co/deadbydawn101/gemma-4-E4B-Agentic-Opus-Reasoning-GeminiCLI-GGUF

SYSTEM "You are a helpful assistant with tool-use capabilities. Think through problems step by step using <think> tags."

PARAMETER temperature 0.7
PARAMETER num_ctx 8192

ollama create ravenx-gemma4 -f Modelfile
ollama run ravenx-gemma4

OpenAI-compatible API

curl http://localhost:11434/v1/chat/completions \
  -H "Content-Type: application/json" \
  -d '{
    "model": "hf.co/deadbydawn101/gemma-4-E4B-Agentic-Opus-Reasoning-GeminiCLI-GGUF",
    "messages": [{"role": "user", "content": "Explain why RSA encryption is hard to break."}]
  }'

---

💻 LM Studio

1. Open LM Studio
2. Search for deadbydawn101/gemma-4-E4B-Agentic-Opus-Reasoning-GeminiCLI-GGUF
3. Download any quantization (Q4_K_M recommended)
4. Load and chat — reasoning is baked in

---

🔧 llama.cpp

CLI

llama-cli \
  -hf deadbydawn101/gemma-4-E4B-Agentic-Opus-Reasoning-GeminiCLI-GGUF \
  -p "Explain why RSA encryption is hard to break." \
  -n 1024

Server (OpenAI-compatible)

llama-server \
  -hf deadbydawn101/gemma-4-E4B-Agentic-Opus-Reasoning-GeminiCLI-GGUF \
  --port 8080

# Use with any OpenAI client
curl http://localhost:8080/v1/chat/completions \
  -H "Content-Type: application/json" \
  -d '{
    "model": "gemma-4-E4B-Agentic-Opus-Reasoning-GeminiCLI-GGUF",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

---

What's different from the base Gemma 4

---

🧪 Live Demos — Try It Now

<div align="center"> </div>

---

🧩 Agent Stack Compatibility

This model is built to sit inside a real agent stack, not just a chat box.

→ Gemini CLI fork · TurboQuant-MLX · RavenX Inference Harness

---

How it was made

Training data

Training

Base:      deadbydawn101/gemma-4-E4B-mlx-4bit
Method:    SFT completions-only (mlx_vlm.lora)
Rank:      8 · Alpha: 16 · LR: 1e-5 · Iters: 1,000
Hardware:  Apple M4 Max 128GB · Peak mem: 7.876 GB

Final loss: ~3.5e-7

Fusion + GGUF Conversion

1. All 378 LoRA pairs merged via weight arithmetic into base weights
2. De-quantized from MLX 4-bit to FP16
3. Converted to GGUF using llama.cpp/convert_hf_to_gguf.py
4. Quantized to multiple GGUF formats using llama-quantize

---

Related Models

---

License

Gemma Terms of Use

---

<div align="center"> Built with 🖤 by <a href="https://github.com/DeadByDawn101">RavenX AI</a> · <a href="https://github.com/DeadByDawn101/turboquant-mlx">TurboQuant-MLX</a> · <a href="https://github.com/DeadByDawn101/gemini-cli">Gemini CLI</a> </div>