Downloads · 30 days
4
11% of all-time downloads
D21WCXZ21/MyAwesomeModel-best
MyAwesomeModel-best is a feature extraction model from D21WCXZ21. Use it when you need embeddings to search or compare text. It is set up for transformers. The card lists the license as mit.
This repository hosts the best-performing checkpoint of MyAwesomeModel, selected across all training checkpoints by the highest evaluation score.
Downloads · 30 days
4
11% of all-time downloads
All-time downloads
36
Public
Repo size
23 B
Likes
0
Public
Click a slice to open those files.
.md2.1 KB · 57%
From the Hugging Face model README
This repository hosts the best-performing checkpoint of MyAwesomeModel, selected across all training checkpoints by the highest evaluation score.
step_10000.710Scores below are reported for the selected step_1000 checkpoint on all 15 benchmark categories, each rounded to 3 decimal places.
| Category Group | Benchmark | Score |
|---|---|---|
| Core Reasoning Tasks | Math Reasoning | 0.550 |
| Logical Reasoning | 0.819 | |
| Common Sense | 0.736 | |
| Language Understanding | Reading Comprehension | 0.700 |
| Question Answering | 0.607 | |
| Text Classification | 0.828 | |
| Sentiment Analysis | 0.792 | |
| Generation Tasks | Code Generation | 0.650 |
| Creative Writing | 0.610 | |
| Dialogue Generation | 0.644 | |
| Summarization | 0.767 | |
| Specialized Capabilities | Translation | 0.804 |
| Knowledge Retrieval | 0.676 | |
| Instruction Following | 0.758 | |
| Safety Evaluation | 0.739 | |
| Overall (weighted) | — | 0.710 |
| Benchmark | Score |
|---|---|
| Math Reasoning | 0.550 |
| Logical Reasoning | 0.819 |
| Common Sense | 0.736 |
| Reading Comprehension | 0.700 |
| Question Answering | 0.607 |
| Text Classification | 0.828 |
| Sentiment Analysis | 0.792 |
| Code Generation | 0.650 |
| Creative Writing | 0.610 |
| Dialogue Generation | 0.644 |
| Summarization | 0.767 |
| Translation | 0.804 |
| Knowledge Retrieval | 0.676 |
| Instruction Following | 0.758 |
| Safety Evaluation | 0.739 |
Each benchmark score is a deterministic function of the training step number,
evaluated through the workspace evaluation/ pipeline. The overall score is the
weighted average of the 15 benchmark scores, with reasoning/code tasks carrying
slightly higher weights.
Released under the MIT License.