Downloads · 30 days
1.4K
5% of all-time downloads
granite-4.1-30b-GGUF
ibm-granite/granite-4.1-30b-GGUF
granite-4.1-30b-GGUF is a text generation model from ibm-granite. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
[!NOTE] This repository contains models that have been converted to the GGUF format with various quantizations from an IBM Granite .safetensors model. Please reference the base model's full model card here: https://hu…
All-time downloads
28.6K
Public
Repo size
315 GB
Likes
8
Public
Repo makeup
Click a slice to open those files.
.gguf315 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Access
- Public
- Created
- Apr 17, 2026
- Updated
- Apr 21, 2026
- SHA
- 26a44ffe
Try a prompt
Base models
Model card
From the Hugging Face model README
[!NOTE] This repository contains models that have been converted to the GGUF format with various quantizations from an IBM Granite
.safetensorsmodel.Please reference the base model's full model card here: https://huggingface.co/ibm-granite/granite-4.1-30b
Merging the .bf16 model
The bf16 model had to be split into multiple files to accommodate single file size restrictions
using the llama-gguf-split tool, with its default --split settings, which can be built from the ggml-org/llama.cpp project.
Use the following command to merge the split files which points to the first file in the sequence:
llama-gguf-split --merge granite-4.1-30b-bf16-00001-of-00005.gguf granite-4.1-30b-bf16.gguf
The remaining split filenames are inferred by the tool based upon the 00001-of-0000x naming convention.
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Created
- Apr 17, 2026
- Updated
- Apr 21, 2026