Downloads · 30 days
330
7% of all-time downloads
GRMR-V3-G4B-GGUF
qingy2024/GRMR-V3-G4B-GGUF
GRMR-V3-G4B-GGUF is a machine learning model from qingy2024. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This repository contains GGUF quantized versions of qingy2024/GRMR-V3-G4B.
All-time downloads
4.6K
Public
Repo size
33.6 GB
Likes
15
Public
Repo makeup
Click a slice to open those files.
.gguf33.6 GB · 100%
At a glance
- Access
- Public
- Created
- Jun 4, 2025
- Updated
- Jun 6, 2025
- SHA
- cd040ad0
Base models
Model card
From the Hugging Face model README
Quantized GGUF models for GRMR-V3-G4B
This repository contains GGUF quantized versions of qingy2024/GRMR-V3-G4B.
IMPORTANT
If using llama.cpp, make sure to set the --jinja flag at the end of your llama-cli or llama-server command, otherwise it won't use the right chat template!
Available quantizations:
- FP16 (full precision)
- Q2_K
- Q3_K_L
- Q3_K_M
- Q3_K_S
- Q4_K_M
- Q4_K_S
- Q5_K_M
- Q5_K_S
- Q6_K
- Q8_0
Original model
This is a quantized version of qingy2024/GRMR-V3-G4B.
Generated on
Fri Jun 6 05:40:02 UTC 2025
- Created
- Jun 4, 2025
- Updated
- Jun 6, 2025