Downloads · 30 days
6
15% of all-time downloads
safafaf22/MyAwesomeModel-step1000
MyAwesomeModel-step1000 is a feature extraction model from safafaf22. Use it when you need embeddings to search or compare text. It is set up for transformers. The card lists the license as mit.
This repository holds the best checkpoint of MyAwesomeModel, selected from the workspace training run (checkpoints/step1000). The selection was made by running the workspace's own evaluation/eval.py pipeline across al…
Downloads · 30 days
6
15% of all-time downloads
All-time downloads
39
Public
Repo size
23 B
Likes
0
Public
Click a slice to open those files.
.md1.8 KB · 52%
From the Hugging Face model README
This repository holds the best checkpoint of MyAwesomeModel, selected from the
workspace training run (checkpoints/step_1000). The selection was made by running
the workspace's own evaluation/eval.py pipeline across all 10 checkpoints
(step_100 … step_1000); step_1000 achieved the highest weighted overall score.
step_10000.712 (highest among all checkpoints)Scores are reported to 3 decimal places.
| # | Benchmark | Score |
|---|---|---|
| 1 | math_reasoning | 0.550 |
| 2 | code_generation | 0.650 |
| 3 | text_classification | 0.828 |
| 4 | sentiment_analysis | 0.792 |
| 5 | question_answering | 0.607 |
| 6 | logical_reasoning | 0.819 |
| 7 | common_sense | 0.736 |
| 8 | reading_comprehension | 0.700 |
| 9 | dialogue_generation | 0.644 |
| 10 | summarization | 0.767 |
| 11 | translation | 0.804 |
| 12 | knowledge_retrieval | 0.676 |
| 13 | creative_writing | 0.610 |
| 14 | instruction_following | 0.758 |
| 15 | safety_evaluation | 0.739 |
The overall score is the weighted average of the 15 benchmark scores, using the
weights defined in evaluation/eval.py (reasoning tasks receive extra weight):
Weighted overall = 0.712.