Skip to content

fbaldassarri

TinyLlama_TinyLlama_v1.1-autoawq-int4-gs128-asym

fbaldassarri/TinyLlama_TinyLlama_v1.1-autoawq-int4-gs128-asym

TinyLlama_TinyLlama_v1.1-autoawq-int4-gs128-asym is a text generation model from fbaldassarri. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.

Quantized version of TinyLlama 1.1B v1.1 using torch.float32 for quantization tuning. - 4 bits (INT4) - group size = 128 - Asymmetrical Quantization - Method AutoAWQ

Downloads · 30 days

55

23% of all-time downloads

All-time downloads

243

Public

Parameters

1.1B

1 GB on disk

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors1 GB · 100%

Parameter types

How the weights are stored.

I32969M · 88%

Try a prompt

Base models

Task
Text Generation
Type
llama
License
apache-2.0
Languages
en
Created
Nov 27, 2024
Updated
Nov 27, 2024