Skip to content

helenai

EleutherAI-gpt-neox-20b-ov-int8

helenai/EleutherAI-gpt-neox-20b-ov-int8

EleutherAI-gpt-neox-20b-ov-int8 is a text generation model from helenai. Use it when you need the model to write or continue text. It is set up for transformers.

This is the EleutherAI/gpt-neox-20b model converted to OpenVINO, for accelerated inference. Model weights are compressed to INT8 with weight compression using nncf.

Downloads · 30 days

11

5% of all-time downloads

All-time downloads

217

Public

Repo size

20.6 GB

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.bin20.6 GB · 100%

At a glance

Task
Text Generation
Library
transformers
Model type
gpt_neox
Access
Public
Created
Feb 2, 2024
Updated
Feb 2, 2024
SHA
05081f25

Try a prompt

Task
Text Generation
Library
transformers
Type
gpt_neox
Languages
en
Created
Feb 2, 2024
Updated
Feb 2, 2024