Downloads · 30 days
7
2% of all-time downloads
gemma-3-1b-it-Q4_0
tanujrai/gemma-3-1b-it-Q4_0
gemma-3-1b-it-Q4_0 is a text generation model from tanujrai. Use it when you need the model to write or continue text. The card lists the license as mit.
This is a Q40 quantized version of the google/gemma-3-1b-it model, converted to GGUF format and optimized for efficient inference. It was created using llama.cpp tools in Google Colab.
All-time downloads
306
Public
Repo size
720 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf720 MB · 100%
At a glance
- Task
- Text Generation
- License
- mit
- Access
- Public
- Created
- Jul 31, 2025
- Updated
- Jul 31, 2025
- SHA
- 6f128f09
Try a prompt
Base models
Model card
From the Hugging Face model README
Gemma-3-1b-it Q4_0 Quantized Model
This is a Q4_0 quantized version of the google/gemma-3-1b-it model, converted to GGUF format and optimized for efficient inference. It was created using llama.cpp tools in Google Colab.
Model Details
- Base Model: google/gemma-3-1b-it
- Quantization: Q4_0 (4-bit quantization)
- Format: GGUF
- Size: ~1–1.5 GB
- Converted Using:
llama.cpp(commit from April 2025) - License: Inherits the license from
google/gemma-3-1b-it
Usage
To use this model with llama.cpp:
./llama-cli -m gemma-3-1b-it-Q4_0.gguf --prompt "Hello, world!" --no-interactive
How It Was Created
- Downloaded
google/gemma-3-1b-itfrom Hugging Face. - Converted to GGUF using
convert_hf_to_gguf.py. - Quantized to Q4_0 using
llama-quantizefromllama.cpp. - Tested in Google Colab with
llama-cli.
Limitations
- Quantization may reduce accuracy compared to the original model.
- Requires
llama.cppor compatible software for inference.
Acknowledgments
- Based on the work of bartowski for GGUF quantization.
- Uses
llama.cppby Georgi Gerganov.
- Task
- Text Generation
- License
- mit
- Created
- Jul 31, 2025
- Updated
- Jul 31, 2025