Downloads · 30 days
147
4% of all-time downloads
noctrex/Gelato-30B-A3B-i1-GGUF
Gelato-30B-A3B-i1-GGUF is a image-to-text model from noctrex. Use it when you need a caption or text from an image.
These are quantizations of the model Gelato-30B-A3B
Downloads · 30 days
147
4% of all-time downloads
All-time downloads
3.6K
Public
Repo size
38.7 GB
Likes
1
Public
Click a slice to open those files.
.gguf38.7 GB · 100%
From the Hugging Face model README
These are quantizations of the model Gelato-30B-A3B
The imatrix has been used from mradermacher.
As most of the quants are available from the great mradermacher team, I will include here only the quants that are missing.
Usage Notes:
mmproj file, the F32 version is recommended for best results (F32 > BF16 > F16).