Downloads · 30 days
193
2% of all-time downloads
gemma-3-12b-it-gguf
chatpdflocal/gemma-3-12b-it-gguf
gemma-3-12b-it-gguf is a machine learning model from chatpdflocal. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
It's very applicable for deploying and using in PCs, laptops or mobiles. gemma-3-12b-it-q40.gguf is the quantization-aware trained(QAT) checkpoints of Gemma 3, 3x less VRAM, while retaining almost the same quality. Re…
All-time downloads
9.3K
Public
Repo size
30.7 GB
Likes
3
Public
Repo makeup
Click a slice to open those files.
.gguf20.6 GB · 82%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Mar 12, 2025
- Updated
- Apr 23, 2026
- SHA
- b21afd71
Model card
From the Hugging Face model README
It's a gguf model file of gemma-3-12b-it, which is developed by Google.
It's very applicable for deploying and using in PCs, laptops or mobiles.
gemma-3-12b-it-q4_0.gguf is the quantization-aware trained(QAT) checkpoints of Gemma 3, 3x less VRAM, while retaining almost the same quality. Recommend it.
Useful local intelligent documents assistant AI tools:
MyDocs is a desktop App which supports Windows and MacOS, and especially for professionals who demand absolute privacy. 100% local processing ensuring total documents sovereignty and zero-cloud dependency.
If you are using Zotero for managing and reading your personal PDFs, PapersGPT is a free plugin which can assist you to chat PDFs effectively by your local gemma-3-12b-it. you can download ChatPDFLocal MacOS app from here, load one or batch PDF files at will, and quickly experience the effect of the model through chat reading.
- License
- apache-2.0
- Created
- Mar 12, 2025
- Updated
- Apr 23, 2026