Downloads · 30 days
18
6% of all-time downloads
mgoin/open_llama_3b_v2-ds
open_llama_3b_v2-ds is a text generation model from mgoin. Use it when you need the model to write or continue text. It is set up for transformers.
https://huggingface.co/openlm-research/openllama3bv2
Downloads · 30 days
18
6% of all-time downloads
All-time downloads
290
Public
Repo size
13.8 GB
Likes
0
Public
Click a slice to open those files.
.data13.7 GB · 99%
From the Hugging Face model README
https://huggingface.co/openlm-research/open_llama_3b_v2
import deepsparse
model = deepsparse.TextGeneration(model="hf:mgoin/open_llama_3b_v2-ds")
model("Tell me a joke.")
git clone https://huggingface.co/openlm-research/open_llama_3b_v2
sparseml.transformers.export_onnx --model_path ./open_llama_3b_v2 --task text-generation --sequence_length 512