Skip to content

fbaldassarri

openlm-research_open_llama_7b_v2-autogptq-int8-gs64-sym

fbaldassarri/openlm-research_open_llama_7b_v2-autogptq-int8-gs64-sym

openlm-research_open_llama_7b_v2-autogptq-int8-gs64-sym is a text generation model from fbaldassarri. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.

Quantized version of openlm-research/openllama7bv2 using torch.float32 for quantization tuning. - 8 bits (INT8) - group size = 64 - Symmetrical Quantization - AutoGPTQ format

Downloads · 30 days

10

18% of all-time downloads

All-time downloads

57

Public

Parameters

6.7B

7.8 GB on disk

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors7.8 GB · 100%

Parameter types

How the weights are stored.

I326.5B · 96%

Try a prompt

Base models

Task
Text Generation
Type
llama
License
apache-2.0
Created
Apr 2, 2025
Updated
Apr 2, 2025