Downloads · 30 days
16
8% of all-time downloads
togethercomputer-RedPajama-INCITE-Chat-3B-v1-ov
helenai/togethercomputer-RedPajama-INCITE-Chat-3B-v1-ov
togethercomputer-RedPajama-INCITE-Chat-3B-v1-ov is a text generation model from helenai. Use it when you need the model to write or continue text. It is set up for transformers.
This is the togethercomputer/RedPajama-INCITE-Chat-3B-v1 model converted to OpenVINO with INT8 weights compression for accelerated inference.
All-time downloads
199
Public
Repo size
4.4 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin2.8 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- gpt_neox
- Access
- Public
- Created
- May 26, 2024
- Updated
- May 26, 2024
- SHA
- 25596855
Try a prompt
Model card
From the Hugging Face model README
togethercomputer/RedPajama-INCITE-Chat-3B-v1
This is the togethercomputer/RedPajama-INCITE-Chat-3B-v1 model converted to OpenVINO with INT8 weights compression for accelerated inference.
An example of how to do inference on this model:
from optimum.intel import OVModelForCausalLM
from transformers import AutoTokenizer, pipeline
# model_id should be set to either a local directory or a model available on the HuggingFace hub.
model_id = "helenai/togethercomputer-RedPajama-INCITE-Chat-3B-v1-ov"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = OVModelForCausalLM.from_pretrained(model_id)
pipe = pipeline("text-generation", model=model, tokenizer=tokenizer)
result = pipe("hello world")
print(result)
- Task
- Text Generation
- Library
- transformers
- Type
- gpt_neox
- Languages
- en
- Created
- May 26, 2024
- Updated
- May 26, 2024