Downloads · 30 days
10
4% of all-time downloads
zephyr-7b-beta-openvino
piimaila/zephyr-7b-beta-openvino
zephyr-7b-beta-openvino is a text generation model from piimaila. Use it when you need the model to write or continue text. The card lists the license as mit.
This model was converted to OpenVINO from HuggingFaceH4/zephyr-7b-beta using optimum-intel via the export space.
All-time downloads
249
Public
Repo size
7.2 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin7.2 GB · 100%
At a glance
- Task
- Text Generation
- License
- mit
- Model type
- mistral
- Access
- Public
- Created
- Oct 19, 2024
- Updated
- Oct 19, 2024
- SHA
- 294160a9
Base models
Model card
From the Hugging Face model README
This model was converted to OpenVINO from HuggingFaceH4/zephyr-7b-beta using optimum-intel
via the export space.
First make sure you have optimum-intel installed:
pip install optimum[openvino]
To load your model you can do as follows:
from optimum.intel import OVModelForCausalLM
model_id = "piimaila/zephyr-7b-beta-openvino"
model = OVModelForCausalLM.from_pretrained(model_id)
- Task
- Text Generation
- Type
- mistral
- License
- mit
- Languages
- en
- Created
- Oct 19, 2024
- Updated
- Oct 19, 2024