Skip to content

fbaldassarri

EleutherAI_pythia-410m-autogptq-int8-gs128-asym

fbaldassarri/EleutherAI_pythia-410m-autogptq-int8-gs128-asym

EleutherAI_pythia-410m-autogptq-int8-gs128-asym is a text generation model from fbaldassarri. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.

Quantized version of EleutherAI/pythia-410m using torch.float32 for quantization tuning. - 8 bits (INT8) - group size = 128 - Asymmetrical Quantization - Method AutoGPTQ

Downloads · 30 days

7

9% of all-time downloads

All-time downloads

75

Public

Parameters

405M

723 MB on disk

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors723 MB · 100%

Parameter types

How the weights are stored.

I32302M · 75%

Try a prompt

Base models

Task
Text Generation
Type
gpt_neox
License
apache-2.0
Languages
en
Created
Feb 2, 2025
Updated
Feb 2, 2025