Downloads · 30 days
4
11% of all-time downloads
thesreedath/gemma-2-2b-qa-raft
gemma-2-2b-qa-raft is a machine learning model from thesreedath. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
LoRA fine-tune of google/gemma-2-2b-it for retrieval-augmented QA: answer from provided context, ignore distractor passages, and refuse when the context lacks the answer. Trained on general-knowledge (fineweb-edu) que…
Downloads · 30 days
4
11% of all-time downloads
All-time downloads
38
Public
Parameters
2.6B
5.3 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors5.2 GB · 99%
From the Hugging Face model README
LoRA fine-tune of google/gemma-2-2b-it for retrieval-augmented QA: answer from provided context, ignore distractor passages, and refuse when the context lacks the answer. Trained on general-knowledge (fineweb-edu) question/answer pairs with golden+distractor contexts.
Held-out eval (Gemini-Flash judge, /10): base closed-book 4.42, base+RAG 4.75, this model+RAG 6.30 (+1.88 vs base, +1.55 vs base+RAG, both p<0.001). Use it WITH retrieved context in the prompt.