Downloads · 30 days
13
13% of all-time downloads
sand-r/granite-3.3-2b-instruct-openvino
granite-3.3-2b-instruct-openvino is a text generation model from sand-r. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This model was converted to OpenVINO from ibm-granite/granite-3.3-2b-instruct using optimum-intel via the export space.
Downloads · 30 days
13
13% of all-time downloads
All-time downloads
101
Public
Repo size
2.5 GB
Likes
0
Public
Click a slice to open those files.
.bin2.5 GB · 100%
From the Hugging Face model README
This model was converted to OpenVINO from ibm-granite/granite-3.3-2b-instruct using optimum-intel
via the export space.
First make sure you have optimum-intel installed:
pip install optimum[openvino]
To load your model you can do as follows:
from optimum.intel import OVModelForCausalLM
model_id = "sand-r/granite-3.3-2b-instruct-openvino"
model = OVModelForCausalLM.from_pretrained(model_id)