Downloads · 30 days
0
mburaksayici/golden_generate_qwen_0.6b_v3
golden_generate_qwen_0.6b_v3 is a machine learning model from mburaksayici. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Repository (HF): mburaksayici/goldengenerateqwen0.6bv3 Repository (GGUF): mburaksayici/goldengenerateqwen0.6bv3gguf Base Model: Qwen3-0.6B Format: FP16 + GGUF quantizations Primary Use: QA generation for RAG evaluation
Downloads · 30 days
0
Access
Public
Updated Dec 4, 2025
Repo size
92.2 MB
Likes
0
Public
Click a slice to open those files.
.safetensors80.8 MB · 84%
From the Hugging Face model README
Repository (HF): mburaksayici/golden_generate_qwen_0.6b_v3
Repository (GGUF): mburaksayici/golden_generate_qwen_0.6b_v3_gguf
Base Model: Qwen3-0.6B
Format: FP16 + GGUF quantizations
Primary Use: QA generation for RAG evaluation
This model is part of SmallEvals — an open-source framework for evaluating retrieval-augmented generation systems by generating high-quality golden QA datasets.
This model is fine-tuned to extract single atomic question-answer pairs from a passage.
Designed for:
The model was trained on:
Training focused on:
The model expects the following instruction format:
Given the passage below, extract ONE question/answer pair grounded strictly in a single atomic fact.
PASSAGE:
"<.<passage>.>"
Return ONLY a JSON object.
{
"question": "When was the Eiffel Tower completed?",
"answer": "1889"
}
llama-cli \
--hf mburaksayici/golden_generate_qwen_0.6b_v3_gguf \
-p "Given the passage below, extract ONE question/answer pair grounded strictly in a single atomic fact.\n\nPASSAGE:\n\"The Eiffel Tower was completed in 1889.\"\n\nReturn ONLY a JSON object."
This repository includes an Ollama Modelfile.
ollama run mburaksayici/golden_generate_qwen_0.6b_v3_gguf
from transformers import AutoModelForCausalLM, AutoTokenizer
model_id = "mburaksayici/golden_generate_qwen_0.6b_v3"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(model_id, device_map="auto")
prompt = """Given the passage below, extract ONE question/answer pair grounded strictly in a single atomic fact.
PASSAGE:
"The Great Wall of China was built over several centuries."
Return ONLY a JSON object.
"""
inputs = tokenizer(prompt, return_tensors="pt").to(model.device)
outputs = model.generate(**inputs, max_new_tokens=128)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))
| File | Description |
|---|---|
Qwen3-0.6B.F16.gguf | Full precision |
Qwen3-0.6B.Q8_0.gguf | Best quality quant |
Qwen3-0.6B.Q5_K_M.gguf | Balanced |
Qwen3-0.6B.Q4_K_M.gguf | Fast + compact |
✅ RAG evaluation
✅ QA dataset generation
✅ Retriever testing
✅ Chunk quality scoring
✅ Benchmark creation
❌ Chatbots
❌ Creative writing
❌ Long-form summarization
❌ Instruction-following
❌ Multi-hop reasoning
Apache-2.0
(Base model license applies)
Qwen3-0.6B.F16.ggufQwen3-0.6B.Q5_K_M.ggufQwen3-0.6B.Q8_0.ggufQwen3-0.6B.Q4_K_M.gguf