Downloads · 30 days
30
13% of all-time downloads
gemma-3-finetune-gguf
mahdishahsavari/gemma-3-finetune-gguf
gemma-3-finetune-gguf is a machine learning model from mahdishahsavari. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This model was finetuned and converted to GGUF format using Unsloth.
All-time downloads
234
Public
Repo size
5 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf5 GB · 100%
At a glance
- Model type
- gemma3
- Access
- Public
- Created
- Nov 21, 2025
- Updated
- Nov 21, 2025
- SHA
- 82bcd46a
Model card
From the Hugging Face model README
gemma-3-finetune-gguf - GGUF
This model was finetuned and converted to GGUF format using Unsloth.
Example usage:
- For text only LLMs: llama-cli --hf repo_id/model_name -p "why is the sky blue?"
- For multimodal models: llama-mtmd-cli -m model_name.gguf --mmproj mmproj_file.gguf
Available Model files:
gemma-3-4b-it.Q8_0.ggufgemma-3-4b-it.F16-mmproj.gguf
⚠️ Ollama Note for Vision Models
Important: Ollama currently does not support separate mmproj files for vision models.
To create an Ollama model from this vision model:
- Place the
Modelfilein the same directory as the finetuned bf16 merged model - Run:
ollama create model_name -f ./Modelfile(Replacemodel_namewith your desired name)
This will create a unified bf16 model that Ollama can use.
- Type
- gemma3
- Created
- Nov 21, 2025
- Updated
- Nov 21, 2025