Qwen3-0.6B-dieter-sft-GGUF

Qwen3-0.6B-dieter-sft-GGUF

This is a GGUF conversion of 4rduino/Qwen3-0.6B-dieter-sft, which is a LoRA fine-tuned version of Qwen/Qwen3-0.6B.

Model Details

• Base Model: Qwen/Qwen3-0.6B
• Fine-tuned Model: 4rduino/Qwen3-0.6B-dieter-sft
• Training: Supervised Fine-Tuning (SFT) with TRL
• Format: GGUF (for llama.cpp, Ollama, LM Studio, etc.)

Available Quantizations

Usage

With llama.cpp

# Download model
huggingface-cli download 4rduino/Qwen3-0.6B-dieter-sft-GGUF Qwen3-0.6B-dieter-sft-q4_k_m.gguf

# Run with llama.cpp
./llama-cli -m Qwen3-0.6B-dieter-sft-q4_k_m.gguf -p "Your prompt here"

With Ollama

1. Create a Modelfile:

FROM ./Qwen3-0.6B-dieter-sft-q4_k_m.gguf

1. Create the model:

ollama create my-model -f Modelfile
ollama run my-model

With LM Studio

1. Download the .gguf file
2. Import into LM Studio
3. Start chatting!

License

Inherits the license from the base model: Qwen/Qwen3-0.6B

Citation

@misc{Qwen3_0.6B_dieter_sft_GGUF},
  author = {4rduino},
  title = {Qwen3-0.6B-dieter-sft-GGUF},
  year = {2025},
  publisher = {{Hugging Face}},
  url = {{https://huggingface.co/4rduino/Qwen3-0.6B-dieter-sft-GGUF}}
}

---

Converted to GGUF format using llama.cpp