Downloads · 30 days
761
1% of all-time downloads
granite-4.0-h-small-FP8
ibm-granite/granite-4.0-h-small-FP8
granite-4.0-h-small-FP8 is a text generation model from ibm-granite. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
📣 Update [10-07-2025]: Added a default system prompt to the chat template to guide the model towards more professional, accurate, and safe responses.
All-time downloads
104K
Public
Parameters
32.6B
33.5 GB on disk
Likes
5
Public
Repo makeup
Click a slice to open those files.
.safetensors33.5 GB · 100%
Parameter types
How the weights are stored.
F8_E4M331.8B · 97%
Try a prompt
Base models
Model card
From the Hugging Face model README
Granite 4.0 H-Small (FP8)
📣 Update [10-07-2025]: Added a default system prompt to the chat template to guide the model towards more professional, accurate, and safe responses.
[!NOTE] This repository contains the FP8 version of Granite-4.0-H-Small.
Please refer to the the original instruct model's model card for additional details: https://huggingface.co/ibm-granite/granite-4.0-h-small
- Task
- Text Generation
- Library
- transformers
- Type
- granitemoehybrid
- License
- apache-2.0
- Created
- Oct 1, 2025
- Updated
- Oct 7, 2025