Downloads · 30 days
165
4% of all-time downloads
iAkashPaul/gemma-2b-it-gguf
gemma-2b-it-gguf is a machine learning model from iAkashPaul. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as other.
Contains Q4 & Q8 quantized GGUFs for google/gemma
Downloads · 30 days
165
4% of all-time downloads
All-time downloads
3.7K
Public
Repo size
9.1 GB
Likes
2
Public
Click a slice to open those files.
.gguf9.1 GB · 100%
From the Hugging Face model README
Contains Q4 & Q8 quantized GGUFs for google/gemma
| Variant | Device | Perf |
|---|---|---|
| Q4 | M1 Pro 10-core GPU | 90 tok/s |
| Snapdragon 778G CPU | 10 tok/s | |
| RTX 2070S | 40 tok/s | |
| Q8 | M1 Pro 10-core GPU | 54 tok/s |
| Snapdragon 778G CPU | 6 tok/s | |
| RTX 2070S | 25 tok/s | |
| F16 | M1 Pro 10-core GPU | 30 tok/s |
| Snapdragon 778G CPU | <1 tok/s |