Downloads · 30 days
9
3% of all-time downloads
TinyLlama-1.1B-GGUF-Optimized
AliMuttahar/TinyLlama-1.1B-GGUF-Optimized
TinyLlama-1.1B-GGUF-Optimized is a machine learning model from AliMuttahar. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This repository contains highly optimized, quantized GGUF models designed for offline-native and edge inference.
All-time downloads
273
Public
Parameters
1.1B
6.2 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf4 GB · 65%
At a glance
- Model type
- llama
- Access
- Public
- Created
- Apr 27, 2026
- Updated
- Apr 27, 2026
- SHA
- 5496edba
Model card
From the Hugging Face model README
Optimized GGUF Models for TinyLlama/TinyLlama-1.1B-Chat-v1.0
This repository contains highly optimized, quantized GGUF models designed for offline-native and edge inference.
📊 Performance Benchmarks (Wikitext-2 Perplexity)
Lower perplexity (PPL) indicates better performance and less degradation.
| Model File | Perplexity Score (PPL) |
|---|---|
model-fp16.gguf | 8.4441 |
model-q4_k_m.gguf | 8.7433 |
model-q8_0.gguf | 8.4484 |
Auto-generated via the GGUF Conversion & Benchmarking Pipeline.
- Type
- llama
- Created
- Apr 27, 2026
- Updated
- Apr 27, 2026