Skip to content

fbaldassarri

EleutherAI_pythia-6.9b-deduped-auto_gptq-int8-gs64-sym

fbaldassarri/EleutherAI_pythia-6.9b-deduped-auto_gptq-int8-gs64-sym

EleutherAI_pythia-6.9b-deduped-auto_gptq-int8-gs64-sym is a text generation model from fbaldassarri. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.

Quantized version of EleutherAI/pythia-6.9b-deduped using torch.bfloat16 for quantization tuning. - 8 bits (INT8) - group size = 64 - Symmetrical Quantization - Method: WoQ — GPTQ (AutoGPTQ algorithm)

Downloads · 30 days

13

22% of all-time downloads

All-time downloads

60

Public

Parameters

2.2B

8.4 GB on disk

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors8.4 GB · 100%

Parameter types

How the weights are stored.

I326.4B · 94%

Try a prompt

Base models

Task
Text Generation
Library
transformers
Type
gpt_neox
License
apache-2.0
Languages
en
Created
Sep 7, 2026
Updated
Sep 7, 2026