Downloads · 30 days
316
12% of all-time downloads
smol-3b-GGUF
afrideva/smol-3b-GGUF
smol-3b-GGUF is a text generation model from afrideva. Use it when you need the model to write or continue text. It is set up for peft. The card lists the license as apache-2.0.
Quantized GGUF model files for smol-3b from rishiraj
All-time downloads
2.6K
Public
Repo size
18.5 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf18.5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- peft
- License
- apache-2.0
- Access
- Public
- Created
- Dec 25, 2023
- Updated
- Dec 25, 2023
- SHA
- 29aa5fc3
Try a prompt
Base models
Model card
From the Hugging Face model README
rishiraj/smol-3b-GGUF
Quantized GGUF model files for smol-3b from rishiraj
| Name | Quant method | Size |
|---|---|---|
| smol-3b.fp16.gguf | fp16 | 6.04 GB |
| smol-3b.q2_k.gguf | q2_k | 1.30 GB |
| smol-3b.q3_k_m.gguf | q3_k_m | 1.51 GB |
| smol-3b.q4_k_m.gguf | q4_k_m | 1.85 GB |
| smol-3b.q5_k_m.gguf | q5_k_m | 2.15 GB |
| smol-3b.q6_k.gguf | q6_k | 2.48 GB |
| smol-3b.q8_0.gguf | q8_0 | 3.21 GB |
Original Model Card:
<!-- This model card has been generated automatically according to the information the Trainer had access to. You should probably proofread and complete it, then remove this comment. -->smol-3b
See how open weights instead of open source feel like!
- Task
- Text Generation
- Library
- peft
- License
- apache-2.0
- Created
- Dec 25, 2023
- Updated
- Dec 25, 2023