Downloads · 30 days
32
28% of all-time downloads
DeepSeek-R1-Distill-Qwen-1.5B-openvino-4bit
windchant/DeepSeek-R1-Distill-Qwen-1.5B-openvino-4bit
DeepSeek-R1-Distill-Qwen-1.5B-openvino-4bit is a text generation model from windchant. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
This model is a quantized version of windchant/DeepSeek-R1-Distill-Qwen-1.5B-openvino and is converted to the OpenVINO format. This model was obtained via the nncf-quantization space with optimum-intel.
All-time downloads
114
Public
Repo size
1.8 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin1.8 GB · 99%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- mit
- Model type
- qwen2
- Access
- Public
- Created
- Mar 11, 2025
- Updated
- Mar 11, 2025
- SHA
- 66983982
Try a prompt
Base models
Model card
From the Hugging Face model README
This model is a quantized version of windchant/DeepSeek-R1-Distill-Qwen-1.5B-openvino and is converted to the OpenVINO format. This model was obtained via the nncf-quantization space with optimum-intel.
First make sure you have optimum-intel installed:
pip install optimum[openvino]
To load your model you can do as follows:
from optimum.intel import OVModelForCausalLM
model_id = "windchant/DeepSeek-R1-Distill-Qwen-1.5B-openvino-4bit"
model = OVModelForCausalLM.from_pretrained(model_id)
- Task
- Text Generation
- Library
- transformers
- Type
- qwen2
- License
- mit
- Created
- Mar 11, 2025
- Updated
- Mar 11, 2025