Downloads · 30 days
23
5% of all-time downloads
ahmedfarazsyk/ms-marco-MiniLM-L6-v2-finetuned-scidocs
ms-marco-MiniLM-L6-v2-finetuned-scidocs is a text ranking model from ahmedfarazsyk. Use it for the text ranking task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
23
5% of all-time downloads
All-time downloads
465
Public
Parameters
22.7M
909 MB on disk
Likes
2
Public
Click a slice to open those files.
.safetensors90.9 MB · 99%
From the Hugging Face model README
This model is a fine-tuned version of cross-encoder/ms-marco-MiniLM-L6-v2 on GreenNode/scidocs-reranking-vn dataset. It achieves the following results on the evaluation set:
This model is a Cross-Encoder for Text Ranking based on the cross-encoder/ms-marco-MiniLM-L6-v2 architecture. It has been fine-tuned to assess the semantic relevance between a query and a document, outputting a score that indicates how likely the document contains the answer or relevant information for the query.
Unlike Bi-Encoders (which map text to vector space), this Cross-Encoder processes the query and document simultaneously, allowing for deep semantic interaction and superior ranking performance, particularly for scientific and technical domains.
cross-encoder/ms-marco-MiniLM-L6-v2(Query, Document)The model was fine-tuned on the SciDocs / GreenNode Scidocs Reranking dataset.
The model was trained using the Hugging Face Trainer API with a custom weighted loss function to address class imbalance.
2e-5To prevent the model from collapsing into predicting "Not Relevant" (due to the 81% negative rate), we implemented a Weighted Binary Cross Entropy Loss.
BCEWithLogitsLoss with pos_weight=5.0.The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 |
|---|---|---|---|---|---|
| 0.753 | 1.0 | 1286 | 0.9168 | 0.9175 | 0.7525 |
| 0.6341 | 2.0 | 2572 | 1.3727 | 0.9153 | 0.7441 |
| 0.4523 | 3.0 | 3858 | 1.2822 | 0.9131 | 0.7468 |
| 0.3555 | 4.0 | 5144 | 1.8419 | 0.9125 | 0.7449 |
| 0.2136 | 5.0 | 6430 | 2.2042 | 0.9119 | 0.7414 |
| 0.1645 | 6.0 | 7716 | 2.7126 | 0.9117 | 0.7384 |
| 0.0733 | 7.0 | 9002 | 3.0462 | 0.9120 | 0.7300 |
| 0.0754 | 8.0 | 10288 | 3.2909 | 0.9120 | 0.7322 |
| 0.0642 | 9.0 | 11574 | 3.1751 | 0.9128 | 0.7439 |
| 0.0425 | 10.0 | 12860 | 3.2852 | 0.9128 | 0.7422 |