Downloads · 30 days
103
7% of all-time downloads
gemma-4-E4B-Gemini-3.1-Pro-Reasoning-Distill-GGUF
Dzluck/gemma-4-E4B-Gemini-3.1-Pro-Reasoning-Distill-GGUF
gemma-4-E4B-Gemini-3.1-Pro-Reasoning-Distill-GGUF is a text generation model from Dzluck. Use it when you need the model to write or continue text. It is set up for gguf.
This repository contains GGUF format model files for Ayodele01's gemma-4-E4B-Gemini-3.1-Pro-Reasoning-Distill.
All-time downloads
1.4K
Public
Repo size
30.2 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf30.2 GB · 100%
At a glance
- Task
- Text Generation
- Library
- gguf
- Access
- Public
- Created
- Jun 20, 2026
- Updated
- Jun 20, 2026
- SHA
- bfb5024f
Try a prompt
Base models
Model card
From the Hugging Face model README
gemma-4-E4B-Gemini-3.1-Pro-Reasoning-Distill-GGUF
This repository contains GGUF format model files for Ayodele01's gemma-4-E4B-Gemini-3.1-Pro-Reasoning-Distill.
These models were compiled and quantized via llama.cpp to enable efficient local inference on consumer hardware.
Available Quantizations
| File Name | Description |
|---|---|
gemma-4-E4B-Gemini-3.1-Pro-Reasoning-Distill-Q8_0.gguf | 8-bit quantization. Near unquantized performance, largest file size. |
gemma-4-E4B-Gemini-3.1-Pro-Reasoning-Distill-Q6_K.gguf | 6-bit quantization. Very high quality, minimal degradation from original. |
gemma-4-E4B-Gemini-3.1-Pro-Reasoning-Distill-Q5_K_M.gguf | 5-bit quantization. Higher quality, slightly larger size and slower inference. |
gemma-4-E4B-Gemini-3.1-Pro-Reasoning-Distill-Q4_K_M.gguf | 4-bit quantization. Recommended. Excellent balance of speed, memory usage, and quality. |
gemma-4-E4B-Gemini-3.1-Pro-Reasoning-Distill-Q3_K_M.gguf | 3-bit quantization. Very high compression, fast inference, lower quality. |
- Task
- Text Generation
- Library
- gguf
- Created
- Jun 20, 2026
- Updated
- Jun 20, 2026