Downloads · 30 days
20
10% of all-time downloads
DeepSeek-R1-Distill-Llama-8B-ov-int8
fakezeta/DeepSeek-R1-Distill-Llama-8B-ov-int8
DeepSeek-R1-Distill-Llama-8B-ov-int8 is a text generation model from fakezeta. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
This model was converted to OpenVINO from deepseek-ai/DeepSeek-R1-Distill-Llama-8B using optimum-intel via the export space.
All-time downloads
208
Public
Repo size
8 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin8 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- mit
- Model type
- llama
- Access
- Public
- Created
- Jan 31, 2025
- Updated
- Jan 31, 2025
- SHA
- 85274631
Try a prompt
Base models
Model card
From the Hugging Face model README
This model was converted to OpenVINO from deepseek-ai/DeepSeek-R1-Distill-Llama-8B using optimum-intel
via the export space.
First make sure you have optimum-intel installed:
pip install optimum[openvino]
To load your model you can do as follows:
from optimum.intel import OVModelForCausalLM
model_id = "fakezeta/DeepSeek-R1-Distill-Llama-8B-openvino"
model = OVModelForCausalLM.from_pretrained(model_id)
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- mit
- Created
- Jan 31, 2025
- Updated
- Jan 31, 2025