Downloads · 30 days
6
1% of all-time downloads
valenradovich/gemma-2-9b-it-Q4_0-gguf
gemma-2-9b-it-Q4_0-gguf is a machine learning model from valenradovich. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
This is a quantized version of the Gemma2 9B instruct model using the Q40 quantization method.
Downloads · 30 days
6
1% of all-time downloads
All-time downloads
536
Public
Repo size
5.4 GB
Likes
0
Public
Click a slice to open those files.
.gguf5.4 GB · 100%
From the Hugging Face model README
This is a quantized version of the Gemma2 9B instruct model using the Q4_0 quantization method.
You can use it directly with llama.cpp