Downloads · 30 days
55
16% of all-time downloads
Digita1Err0r/Qwen2-0.5B-cots-finetune-gguf
Qwen2-0.5B-cots-finetune-gguf is a machine learning model from Digita1Err0r. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This is a GGUF conversion of Digita1Err0r/Qwen2-0.5B-cots-finetune, which is a LoRA fine-tuned version of Qwen/Qwen2-0.5B.
Downloads · 30 days
55
16% of all-time downloads
All-time downloads
343
Public
Repo size
2.3 GB
Likes
0
Public
Click a slice to open those files.
.gguf2.3 GB · 100%
From the Hugging Face model README
This is a GGUF conversion of Digita1Err0r/Qwen2-0.5B-cots-finetune, which is a LoRA fine-tuned version of Qwen/Qwen2-0.5B.
| File | Quant | Size | Description | Use Case |
|---|---|---|---|---|
| Qwen2-0.5B-cots-finetune-f16.gguf | F16 | ~1GB | Full precision | Best quality, slower |
| Qwen2-0.5B-cots-finetune-q8_0.gguf | Q8_0 | ~500MB | 8-bit | High quality |
| Qwen2-0.5B-cots-finetune-q5_k_m.gguf | Q5_K_M | ~350MB | 5-bit medium | Good quality, smaller |
| Qwen2-0.5B-cots-finetune-q4_k_m.gguf | Q4_K_M | ~300MB | 4-bit medium | Recommended - good balance |
# Download model
huggingface-cli download Digita1Err0r/Qwen2-0.5B-cots-finetune-gguf Qwen2-0.5B-cots-finetune-q4_k_m.gguf
# Run with llama.cpp
./llama-cli -m Qwen2-0.5B-cots-finetune-q4_k_m.gguf -p "Your prompt here"
Modelfile:FROM ./Qwen2-0.5B-cots-finetune-q4_k_m.gguf
ollama create my-model -f Modelfile
ollama run my-model
.gguf fileInherits the license from the base model: Qwen/Qwen2-0.5B
@misc{Qwen2_0.5B_cots_finetune_gguf,
author = {Digita1Err0r},
title = {Qwen2-0.5B-cots-finetune-gguf},
year = {2025},
publisher = {Hugging Face},
url = {https://huggingface.co/Digita1Err0r/Qwen2-0.5B-cots-finetune-gguf}
}
Converted to GGUF format using llama.cpp