Skip to content

fbaldassarri

allenai_OLMo-2-1124-7B-autoround-int4-gs128-sym

fbaldassarri/allenai_OLMo-2-1124-7B-autoround-int4-gs128-sym

allenai_OLMo-2-1124-7B-autoround-int4-gs128-sym is a text generation model from fbaldassarri. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.

Quantized version of allenai/OLMo-2-1124-7B using torch.float32 for quantization tuning. - 4 bits (INT4) - group size = 128 - Symmetrical Quantization - Method WoQ (AutoRound format)

Downloads · 30 days

5

3% of all-time downloads

All-time downloads

168

Public

Parameters

1.7B

6.7 GB on disk

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors6.7 GB · 100%

Parameter types

How the weights are stored.

F32823M · 49%

Try a prompt

Base models

Task
Text Generation
Type
olmo2
License
apache-2.0
Languages
en
Created
Dec 12, 2024
Updated
Dec 12, 2024