Downloads · 30 days
8
24% of all-time downloads
emb-rag-qwen06b-indirect-rl
Icey444/emb-rag-qwen06b-indirect-rl
emb-rag-qwen06b-indirect-rl is a reinforcement learning model from Icey444. Use it for the reinforcement learning task on the model card, and read the license before you ship it in a product. It is set up for peft.
LoRA adapter for Qwen/Qwen3-Embedding-0.6B — Indirect-feedback RL (Ours, LR 1e-5, 10k queries).
All-time downloads
33
Public
Repo size
92.2 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors80.8 MB · 84%
At a glance
- Task
- Reinforcement Learning
- Library
- peft
- Access
- Public
- Created
- Jul 14, 2026
- Updated
- Jul 14, 2026
- SHA
- c16ed33e
Base models
Model card
From the Hugging Face model README
emb-rag-qwen06b-indirect-rl
LoRA adapter for Qwen/Qwen3-Embedding-0.6B — Indirect-feedback RL (Ours, LR 1e-5, 10k queries).
Trained on multi-hop MuSiQue; evaluated on MuSiQue (in-domain) + 2WikiMultiHopQA, HotpotQA, NQ, TriviaQA (OOD).
Indirect feedback = the reward is a frozen reader LLM's answer success (log p(gold answer | query, retrieved context)) — no passage-level relevance labels. Rel-SFT = the direct-supervision baseline (contrastive InfoNCE on gold passages).
Full results (retrieval R@k + downstream RAG accuracy) and training scripts: https://irisicy4.github.io/exp-record/projects/indirect-rag/
from peft import PeftModel
from transformers import AutoModel, AutoTokenizer
base = AutoModel.from_pretrained("Qwen/Qwen3-Embedding-0.6B")
model = PeftModel.from_pretrained(base, "Icey444/emb-rag-qwen06b-indirect-rl").merge_and_unload()
tok = AutoTokenizer.from_pretrained("Icey444/emb-rag-qwen06b-indirect-rl")
- Task
- Reinforcement Learning
- Library
- peft
- Created
- Jul 14, 2026
- Updated
- Jul 14, 2026