Downloads · 30 days
461
7% of all-time downloads
TinyLlama-1.1B-Chat-v1.0-GGUF
pbatra/TinyLlama-1.1B-Chat-v1.0-GGUF
TinyLlama-1.1B-Chat-v1.0-GGUF is a text generation model from pbatra. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This repository contains quantized versions of the model from the original repository: TinyLlama/TinyLlama-1.1B-Chat-v1.0.
All-time downloads
6.8K
Public
Repo size
15 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf15 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Access
- Public
- Created
- May 15, 2024
- Updated
- May 15, 2024
- SHA
- d6085e9d
Try a prompt
Base models
Model card
From the Hugging Face model README
TinyLlama-1.1B-Chat-v1.0
This repository contains quantized versions of the model from the original repository: TinyLlama/TinyLlama-1.1B-Chat-v1.0.
| Name | Quantization Method | Size (GB) |
|---|---|---|
| tinyllama-1.1b-chat-v1.0.fp16.gguf | FP16 | 2.05 |
| tinyllama-1.1b-chat-v1.0.fp32.gguf | FP32 | 4.10 |
| tinyllama-1.1b-chat-v1.0.Q2_K.gguf | q2_k | 0.40 |
| tinyllama-1.1b-chat-v1.0.Q3_K_S.gguf | q3_k_s | 0.47 |
| tinyllama-1.1b-chat-v1.0.Q3_K_M.gguf | q3_k_m | 0.51 |
| tinyllama-1.1b-chat-v1.0.Q3_K_L.gguf | q3_k_l | 0.55 |
| tinyllama-1.1b-chat-v1.0.Q4_0.gguf | q4_0 | 0.59 |
| tinyllama-1.1b-chat-v1.0.Q4_K_S.gguf | q4_k_s | 0.60 |
| tinyllama-1.1b-chat-v1.0.Q4_K_M.gguf | q4_k_m | 0.62 |
| tinyllama-1.1b-chat-v1.0.Q5_0.gguf | q5_0 | 0.71 |
| tinyllama-1.1b-chat-v1.0.Q5_K_S.gguf | q5_k_s | 0.71 |
| tinyllama-1.1b-chat-v1.0.Q5_K_M.gguf | q5_k_m | 0.73 |
| tinyllama-1.1b-chat-v1.0.Q6_K.gguf | q6_k | 0.84 |
| tinyllama-1.1b-chat-v1.0.Q8_0.gguf | q8_0 | 1.09 |
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Languages
- en
- Created
- May 15, 2024
- Updated
- May 15, 2024