Downloads · 30 days
8.2K
18% of all-time downloads
ggml-org/gemma-3-4b-it-qat-GGUF
gemma-3-4b-it-qat-GGUF is a machine learning model from ggml-org. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Downloads · 30 days
8.2K
18% of all-time downloads
All-time downloads
46.9K
Public
Repo size
4.2 GB
Likes
7
Public
Click a slice to open those files.
.gguf3.4 GB · 100%
From the Hugging Face model README
Recommended way to run this model:
llama-server -hf ggml-org/gemma-3-4b-it-qat-GGUF -c 0 -fa
Then, access http://localhost:8080