Downloads · 30 days
6
11% of all-time downloads
hhhhwhit/lrat-qwen3-0.6b-utility-weighted-20260723
lrat-qwen3-0.6b-utility-weighted-20260723 is a feature extraction model from hhhhwhit. Use it when you need embeddings to search or compare text. It is set up for transformers. The card lists the license as apache-2.0.
This retriever is trained from the released LRAT trajectory positives using a two-stage supervision pipeline:
Downloads · 30 days
6
11% of all-time downloads
All-time downloads
54
Public
Parameters
596M
1.2 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors1.2 GB · 99%
From the Hugging Face model README
This retriever is trained from the released LRAT trajectory positives using a two-stage supervision pipeline:
Utility scores map to raw weights {0: 0.50, 1: 0.75, 2: 1.00, 3: 1.50, 4: 2.00}. The raw weights are divided by their global dataset mean before
training. The objective is weighted InfoNCE,
sum_i(w_i * loss_i) / sum_i(w_i). No pairwise loss or reasoning-length weight
is used.
Qwen/Qwen3-Embedding-0.6BYuqi-Zhou/LRAT-Train positives and negatives1e-60.10.02Query instruction:
Instruct: Given a web search query, retrieve relevant passages that answer the query
Query:{query}
The repository contains a full Transformers checkpoint and tokenizer files.