Downloads · 30 days
4
4% of all-time downloads
SmolLM2-135M-4-bit
kevinharry/SmolLM2-135M-4-bit
SmolLM2-135M-4-bit is a machine learning model from kevinharry. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
This repository contains a 4-bit quantized version of the HuggingFaceTB/SmolLM2-135M model, using the q40 quantization method from llama.cpp, stored in the GGUF file format. Quantization reduces the model's size and m…
All-time downloads
99
Public
Repo size
91.7 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf91.7 MB · 100%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Feb 18, 2025
- Updated
- Feb 18, 2025
- SHA
- 72943ab3
Model card
From the Hugging Face model README
SmolLM2-135M-4-bit
This repository contains a 4-bit quantized version of the HuggingFaceTB/SmolLM2-135M model, using the q4_0 quantization method from llama.cpp, stored in the GGUF file format. Quantization reduces the model's size and memory footprint while maintaining its core capabilities, making it suitable for deployment on resource-constrained environments such as edge devices, mobile platforms, or lightweight inference tasks.
Quantization Details: Base Model: HuggingFaceTB/SmolLM2-135M Quantization Method: q4_0 (4-bit) Framework Used: llama.cpp File Format: GGUF
- License
- apache-2.0
- Languages
- en
- Created
- Feb 18, 2025
- Updated
- Feb 18, 2025