Downloads · 30 days
323
17% of all-time downloads
SmolLM2-360M-F32-GGUF
prithivMLmods/SmolLM2-360M-F32-GGUF
SmolLM2-360M-F32-GGUF is a text generation model from prithivMLmods. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
SmolLM2-360M-Instruct : The 360M model was trained on 4 trillion tokens using a diverse dataset combination: FineWeb-Edu, DCLM, The Stack, along with new filtered datasets we curated and will release soon. We develope…
All-time downloads
1.9K
Public
Repo size
5.7 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.gguf5.7 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- Jun 7, 2025
- Updated
- Jun 7, 2025
- SHA
- 7bcc1b24
Try a prompt
Base models
Model card
From the Hugging Face model README
SmolLM2-360M-Instruct
SmolLM2-360M-Instruct : The 360M model was trained on 4 trillion tokens using a diverse dataset combination: FineWeb-Edu, DCLM, The Stack, along with new filtered datasets we curated and will release soon. We developed the instruct version through supervised fine-tuning (SFT) using a combination of public datasets and our own curated datasets. We then applied Direct Preference Optimization (DPO) using UltraFeedback.
Model Files
| File Name | Size | Format Description |
|---|---|---|
| SmolLM2-360M-Instruct.F32.gguf | 1.45 GB | Full precision (32-bit floating point) |
| SmolLM2-360M-Instruct.BF16.gguf | 726 MB | Brain floating point 16-bit |
| SmolLM2-360M-Instruct.F16.gguf | 726 MB | Half precision (16-bit floating point) |
| SmolLM2-360M-Instruct.Q8_0.gguf | 386 MB | 8-bit quantization |
| SmolLM2-360M-Instruct.Q6_K.gguf | 367 MB | 6-bit quantization (K-quant) |
| SmolLM2-360M-Instruct.Q5_K_M.gguf | 290 MB | 5-bit quantization (K-quant, medium) |
| SmolLM2-360M-Instruct.Q5_K_S.gguf | 283 MB | 5-bit quantization (K-quant, small) |
| SmolLM2-360M-Instruct.Q4_K_M.gguf | 271 MB | 4-bit quantization (K-quant, medium) |
| SmolLM2-360M-Instruct.Q4_K_S.gguf | 260 MB | 4-bit quantization (K-quant, small) |
| SmolLM2-360M-Instruct.Q3_K_L.gguf | 246 MB | 3-bit quantization (K-quant, large) |
| SmolLM2-360M-Instruct.Q3_K_M.gguf | 235 MB | 3-bit quantization (K-quant, medium) |
| SmolLM2-360M-Instruct.Q3_K_S.gguf | 219 MB | 3-bit quantization (K-quant, small) |
| SmolLM2-360M-Instruct.Q2_K.gguf | 219 MB | 2-bit quantization (K-quant) |
Quants Usage
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
Here is a handy graph by ikawrakow comparing some lower-quality quant types (lower is better):
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- apache-2.0
- Languages
- en
- Created
- Jun 7, 2025
- Updated
- Jun 7, 2025