Downloads · 30 days
133
3% of all-time downloads
granite-34b-code-instruct-8k-GGUF
ibm-granite/granite-34b-code-instruct-8k-GGUF
granite-34b-code-instruct-8k-GGUF is a text generation model from ibm-granite. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
All-time downloads
3.8K
Public
Repo size
21.4 GB
Likes
8
Public
Repo makeup
Click a slice to open those files.
.gguf21.4 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Access
- Public
- Created
- May 20, 2024
- Updated
- Apr 25, 2026
- SHA
- 4e7bb6bc
Try a prompt
Base models
Model card
From the Hugging Face model README
⚠️ DEPRECATION WARNING ⚠️
⚠️ NOT RECOMMENDED FOR USE IN NEW PROJECTS ⚠️
New applications/projects should use the latest mainline Granite language model family, whose code capabilities supercede this model. This model is being made available strictly for historical/scientific purposes. Please see our Granite Collections for the latest Granite releases.
ibm-granite/granite-34b-code-instruct-8k-GGUF
This is the Q4_K_M converted version of the original ibm-granite/granite-34b-code-instruct-8k.
Refer to the original model card for more details.
Use with llama.cpp
git clone https://github.com/ggerganov/llama.cpp
cd llama.cpp
# install
make
# run generation
./main -m granite-34b-code-instruct-8k-GGUF/granite-34b-code-instruct.Q4_K_M.gguf -n 128 -p "def generate_random(x: int):" --color
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Created
- May 20, 2024
- Updated
- Apr 25, 2026