Downloads · 30 days
177
11% of all-time downloads
lm-kit/qwen-2.5-3.1b-instruct-gguf
qwen-2.5-3.1b-instruct-gguf is a machine learning model from lm-kit. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as other.
This repository hosts quantized versions of the Qwen2.5-3B-Instruct model.
Downloads · 30 days
177
11% of all-time downloads
All-time downloads
1.6K
Public
Repo size
26.2 GB
Likes
0
Public
Click a slice to open those files.
.gguf26.2 GB · 100%
From the Hugging Face model README
This repository hosts quantized versions of the Qwen2.5-3B-Instruct model.
Format: GGUF
Converter: llama.cpp 9ba399dfa7f115effc63d48e6860a94c9faa31b2
Quantizer: LM-Kit.NET 2024.12.11
For more detailed information on the base model, please visit the following link: