Downloads · 30 days
0
OneFly7/qwen3-embedding-0p6b-sentence-scorer-sxxx-pointwise
qwen3-embedding-0p6b-sentence-scorer-sxxx-pointwise is a text classification model from OneFly7. Use it when you need a label for a piece of text. It is set up for transformers.
This repository contains a trained encoder plus a regression head for sentence salience scoring.
Downloads · 30 days
0
Access
Public
Updated Jul 1, 2026
Parameters
596M
2.4 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors2.4 GB · 100%
How the weights are stored.
BF16596M · 100%
From the Hugging Face model README
This repository contains a trained encoder plus a regression head for sentence salience scoring.
encoder/: fine-tuned encoder saved with AutoModel.save_pretrained.regression_head.pt: linear regression head state dict.qwen3_embedding_sentence_scorer_config.json: scorer settings used during training.sentence_scorer_inference.py: minimal PyTorch inference helper.from sentence_scorer_inference import load_sentence_scorer
model, tokenizer, device = load_sentence_scorer("OneFly7/qwen3-embedding-0p6b-sentence-scorer-sxxx-pointwise")
texts = ["[S001] Example article sentence. Summary candidate: example summary."]
scores = model.predict(texts, tokenizer, device=device, max_length=4096)
print(scores)
Training source directory:
/lustre/fswork/projects/rech/ges/uuy33zj/multi_lingual_self_distill/multi_lingual_self_distll/models/sentence_scorer_runs/qwen3_embedding_0p6b_pointwise_jz_sxxx_bs16_lr1e5
Scorer settings:
pooling=last_token
dropout=0.1
max_length=4096