Downloads · 30 days
157
7% of all-time downloads
gemma-4-12B-it-GGUF
MoMonir/gemma-4-12B-it-GGUF
gemma-4-12B-it-GGUF is a image-text-to-text model from MoMonir. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Quantized GGUF versions of google/gemma-4-12B-it, created with llama.cpp.
All-time downloads
2.4K
Public
Repo size
62.4 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf62.4 GB · 100%
At a glance
- Task
- Image-Text-to-Text
- License
- apache-2.0
- Access
- Public
- Created
- Jun 5, 2026
- Updated
- Jun 5, 2026
- SHA
- 1c173442
Try a prompt
Base models
Model card
From the Hugging Face model README
gemma-4-12B-it-GGUF
Quantized GGUF versions of google/gemma-4-12B-it, created with llama.cpp.
Usage
With llama.cpp
llama-cli -hf MoMonir/gemma-4-12B-it-GGUF
With llama-cpp-python
from llama_cpp import Llama
llm = Llama.from_pretrained(repo_id="MoMonir/gemma-4-12B-it-GGUF", filename="google_gemma-4-12B-it-Q8_0.gguf")
response = llm("Hello, world!", max_tokens=100)
print(response["choices"][0]["text"])
License
Please refer to the original model license.
- Task
- Image-Text-to-Text
- License
- apache-2.0
- Created
- Jun 5, 2026
- Updated
- Jun 5, 2026