Downloads · 30 days
19
5% of all-time downloads
dolly-v2-3b-ov
katuni4ka/dolly-v2-3b-ov
dolly-v2-3b-ov is a text generation model from katuni4ka. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
This is the databricks/dolly-v2-3b model converted to OpenVINO, for accellerated inference.
All-time downloads
400
Public
Repo size
11.1 GB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.bin11.1 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- mit
- Model type
- gpt_neox
- Access
- Public
- Created
- Jun 2, 2023
- Updated
- Jun 2, 2023
- SHA
- c7f3f7ab
Try a prompt
Datasets
Model card
From the Hugging Face model README
databricks/dolly-v2-3b
This is the databricks/dolly-v2-3b model converted to OpenVINO, for accellerated inference.
An example of how to do inference on this model:
from optimum.intel.openvino import OVModelForCausalLM
from transformers import AutoTokenizer, pipeline
# model_id should be set to either a local directory or a model available on the HuggingFace hub.
model_id = "katuni4ka/dolly-v2-3b-ov"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = OVModelForCausalLM.from_pretrained(model_id)
pipe = pipeline("text-generation", model=model, tokenizer=tokenizer)
result = pipe("hello world")
print(result)
More detailed example how to use model in instruction following scenario, can be found in this notebook
- Task
- Text Generation
- Library
- transformers
- Type
- gpt_neox
- License
- mit
- Languages
- en
- Created
- Jun 2, 2023
- Updated
- Jun 2, 2023