Downloads · 30 days
30
5% of all-time downloads
SmolLM2-135M.gguf
kratark/SmolLM2-135M.gguf
SmolLM2-135M.gguf is a text generation model from kratark. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This repository contains a converted version of the SmolLM2-135M model in GGUF format, optimized for CPU and local inference.
All-time downloads
589
Public
Repo size
271 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf271 MB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Access
- Public
- Created
- Jun 6, 2026
- Updated
- Jun 8, 2026
- SHA
- 324ebc67
Try a prompt
Base models
Model card
From the Hugging Face model README
SmolLM2-135M-GGUF
This repository contains a converted version of the SmolLM2-135M model in GGUF format, optimized for CPU and local inference.
Original model: https://huggingface.co/HuggingFaceTB/SmolLM2-135M
Model Description
SmolLM2-135M is a small language model created by Hugging Face for efficient text generation with low resource usage.
This repository does not modify or retrain the model.
It only includes:
- Conversion from Transformers → GGUF format
- Preparation for inference with tools like llama.cpp
Usage
llama.cpp example
./main -m smollm2-135m.gguf -p "Gravity is"
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Languages
- en
- Created
- Jun 6, 2026
- Updated
- Jun 8, 2026