Downloads · 30 days
756
68% of all-time downloads
rodrigomt/granite-4.0-h-small-heretic-high-GGUF
granite-4.0-h-small-heretic-high-GGUF is a text generation model from rodrigomt. Use it when you need the model to write or continue text.
Quantized version of: pszemraj/granite-4.0-h-small-heretichi
Downloads · 30 days
756
68% of all-time downloads
All-time downloads
1.1K
Public
Repo size
83.2 GB
Likes
0
Public
Click a slice to open those files.
.gguf83.2 GB · 100%
From the Hugging Face model README
Quantized version of: pszemraj/granite-4.0-h-small-heretic_hi
| Format | Description |
|---|---|
| F16 | Full precision (16-bit), better quality, larger size ⚖️ |
| Q4_K_XL | Quantized (4-bit XL variant, based on the quantization table of the unsloth model granite-4.0-h-small), smaller size, faster inference ⚡ |
Example with llama.cpp:
./main -m ./gguf-file-name.gguf -p "Hello world!"