Downloads · 30 days
162
8% of all-time downloads
beleata74/BgGPT-Gemma-3-27B-IT-GGUF-Q4_K_M-mmproj
BgGPT-Gemma-3-27B-IT-GGUF-Q4_K_M-mmproj is a image-text-to-text model from beleata74. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. The card lists the license as gemma.
This repository packages a working llama.cpp multimodal setup for BgGPT-Gemma-3-27B-IT:
Downloads · 30 days
162
8% of all-time downloads
All-time downloads
2K
Public
Repo size
17.4 GB
Likes
2
Public
Click a slice to open those files.
.gguf17.4 GB · 100%
From the Hugging Face model README
This repository packages a working llama.cpp multimodal setup for BgGPT-Gemma-3-27B-IT:
BgGPT-Gemma-3-27B-IT-Q4_K_M.ggufmmproj-bggpt-gemma3-27b-it-BF16.ggufThe GGUF model file comes from the original quantized release by INSAIT.
The mmproj file was generated from the base Hugging Face model with llama.cpp/convert_hf_to_gguf.py --mmproj, so image input works in llama-server and llama-mtmd-cli.
mmproj file required for image understanding in llama.cppllama-server \
-m BgGPT-Gemma-3-27B-IT-Q4_K_M.gguf \
--mmproj mmproj-bggpt-gemma3-27b-it-BF16.gguf \
--host 0.0.0.0 \
--port 8080 \
-c 4096 \
--gpu-layers all
{
"model": "BgGPT-Gemma-3-27B-IT-Q4_K_M.gguf",
"messages": [
{
"role": "user",
"content": [
{"type": "text", "text": "Опиши какво има на изображението."},
{"type": "image_url", "image_url": {"url": "data:image/jpeg;base64,..."}}
]
}
]
}
llama.cpp CUDA build and the OpenAI-compatible server endpoint.