Skip to content

nicholasKluge

TeenyTinyLlama-460m-Chat-awq

nicholasKluge/TeenyTinyLlama-460m-Chat-awq

TeenyTinyLlama-460m-Chat-awq is a text generation model from nicholasKluge. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.

Note: This model is a quantized version of TeenyTinyLlama-460m. Quantization was performed using AutoAWQ, allowing this version to be 80% lighter, 20% faster, and with almost no performance loss. A GPU is required to…

Downloads · 30 days

19

2% of all-time downloads

All-time downloads

889

Public

Parameters

468M

340 MB on disk

Likes

1

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors340 MB · 100%

Parameter types

How the weights are stored.

I32403M · 86%

Base models

Task
Text Generation
Library
transformers
Type
llama
License
apache-2.0
Languages
pt
Created
Jan 21, 2024
Updated
Jan 15, 2025