Downloads · 30 days
23
14% of all-time downloads
user0199939/VibeThinker-1.5B-openvino-4bit
VibeThinker-1.5B-openvino-4bit is a text generation model from user0199939. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
This model is a quantized version of WeiboAI/VibeThinker-1.5B and is converted to the OpenVINO format. This model was obtained via the nncf-quantization space with optimum-intel.
Downloads · 30 days
23
14% of all-time downloads
All-time downloads
161
Public
Repo size
927 MB
Likes
0
Public
Click a slice to open those files.
.bin915 MB · 98%
From the Hugging Face model README
This model is a quantized version of WeiboAI/VibeThinker-1.5B and is converted to the OpenVINO format. This model was obtained via the nncf-quantization space with optimum-intel.
First make sure you have optimum-intel installed:
pip install optimum[openvino]
To load your model you can do as follows:
from optimum.intel import OVModelForCausalLM
model_id = "user0199939/VibeThinker-1.5B-openvino-4bit"
model = OVModelForCausalLM.from_pretrained(model_id)