Downloads · 30 days
31
7% of all-time downloads
Qwen2.5-1.5B-Instruct-GGUF-Q4_K_M
MR-CODESPIKE/Qwen2.5-1.5B-Instruct-GGUF-Q4_K_M
Qwen2.5-1.5B-Instruct-GGUF-Q4_K_M is a machine learning model from MR-CODESPIKE. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This repository publishes a GGUF-format, Q4KM quantized artifact identified as a Qwen2.5 1.5B Instruct model. It is intended for local, lightweight inference with GGUF-compatible runtimes.
All-time downloads
465
Public
Repo size
992 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf986 MB · 100%
At a glance
- Access
- Public
- Created
- Jul 13, 2026
- Updated
- Sep 4, 2026
- SHA
- 13b0bb20
Model card
From the Hugging Face model README
Qwen2.5 1.5B Instruct GGUF — Q4_K_M
This repository publishes a GGUF-format, Q4_K_M quantized artifact identified as a Qwen2.5 1.5B Instruct model. It is intended for local, lightweight inference with GGUF-compatible runtimes.
Usage
The checkpoint is suitable for experimentation, offline assistants, and embedded or low-memory environments. It should not be used as the sole authority for medical, legal, financial, safety-critical, or other high-impact decisions. Consult the upstream Qwen model card and license for provenance and permitted use.
pip install llama-cpp-python
Load the GGUF file with a llama.cpp-compatible runtime and use the upstream Qwen2.5 Instruct chat template. Tune context length, GPU layers, and sampling settings for the target hardware.
Reproducibility
Keep the exact file revision and runtime version with experiment logs. Q4_K_M is a quantization variant, so memory use, latency, and output quality will differ from the original model and from other quantization schemes.
- Created
- Jul 13, 2026
- Updated
- Sep 4, 2026