Downloads · 30 days
13
2% of all-time downloads
RajashekarV/Qwen3-0.6B-Finetuned-GGUF
Qwen3-0.6B-Finetuned-GGUF is a text generation model from RajashekarV. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
This is a GGUF version of the Qwen2.5-0.5B model fine-tuned on a subset of the Codeforces dataset. It has been quantized to 4-bit (Q4KM) for efficient local inference.
Downloads · 30 days
13
2% of all-time downloads
All-time downloads
652
Public
Repo size
2 GB
Likes
0
Public
Click a slice to open those files.
.gguf2 GB · 100%
From the Hugging Face model README
This is a GGUF version of the Qwen2.5-0.5B model fine-tuned on a subset of the Codeforces dataset. It has been quantized to 4-bit (Q4_K_M) for efficient local inference.
You can use this model with llama.cpp, Ollama, or LM Studio.
./llama-cli -m qwen2.5-0.5b-codeforces-fast-q4_k_m.gguf -p "Write a C++ solution for Two Sum" -n 512