Downloads · 30 days
384
8% of all-time downloads
layerskip-llama3.2-1B-GGUF
matrixportalx/layerskip-llama3.2-1B-GGUF
layerskip-llama3.2-1B-GGUF is a text generation model from matrixportalx. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama3.2.
- Quantization Tool: llama.cpp - Version: version: 5092 (d3bd7193)
All-time downloads
4.6K
Public
Repo size
12.5 GB
Likes
2
Trending 2
Repo makeup
Click a slice to open those files.
.gguf12.5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- llama3.2
- Access
- Public
- Created
- Apr 9, 2025
- Updated
- Apr 9, 2025
- SHA
- fc441f7a
Try a prompt
Base models
Model card
From the Hugging Face model README
layerskip-llama3.2-1B GGUF Quantized Models
Technical Details
- Quantization Tool: llama.cpp
- Version: version: 5092 (d3bd7193)
Model Information
- Base Model: facebook/layerskip-llama3.2-1B
- Quantized by: matrixportal
Available Files
layerskip-llama3.2-1b.q2_k.gguf(553.96MB)layerskip-llama3.2-1b.q3_k_s.gguf(611.96MB)layerskip-llama3.2-1b.q3_k_m.gguf(658.84MB)layerskip-llama3.2-1b.q3_k_l.gguf(698.59MB)layerskip-llama3.2-1b.q4_0.gguf(735.21MB)layerskip-llama3.2-1b.q4_k_s.gguf(739.71MB)layerskip-llama3.2-1b.q4_k_m.gguf(770.27MB)layerskip-llama3.2-1b.q5_0.gguf(851.21MB)layerskip-llama3.2-1b.q5_k_s.gguf(851.21MB)layerskip-llama3.2-1b.q5_k_m.gguf(869.27MB)layerskip-llama3.2-1b.q6_k.gguf(974.46MB)layerskip-llama3.2-1b.q8_0.gguf(1259.88MB)layerskip-llama3.2-1b.f16.gguf(2364.72MB)
💡 Q4_K_M provides the best balance for most use cases
- Task
- Text Generation
- Library
- transformers
- License
- llama3.2
- Languages
- en
- Created
- Apr 9, 2025
- Updated
- Apr 9, 2025