Downloads · 30 days
11
5% of all-time downloads
helenai/EleutherAI-gpt-neox-20b-ov-int8
EleutherAI-gpt-neox-20b-ov-int8 is a text generation model from helenai. Use it when you need the model to write or continue text. It is set up for transformers.
This is the EleutherAI/gpt-neox-20b model converted to OpenVINO, for accelerated inference. Model weights are compressed to INT8 with weight compression using nncf.
Downloads · 30 days
11
5% of all-time downloads
All-time downloads
217
Public
Repo size
20.6 GB
Likes
0
Public
Click a slice to open those files.
.bin20.6 GB · 100%
From the Hugging Face model README
This is the EleutherAI/gpt-neox-20b model converted to OpenVINO, for accelerated inference. Model weights are compressed to INT8 with weight compression using nncf.
Use optimum-intel for inference (documentation).