Downloads · 30 days
3
14% of all-time downloads
DSAD12DSA4TRFDS/my-awesome-model
my-awesome-model is a feature extraction model from DSAD12DSA4TRFDS. Use it when you need embeddings to search or compare text. It is set up for transformers. The card lists the license as mit.
Best checkpoint selected from the training run by highest weighted eval accuracy across 15 benchmark categories. Selected checkpoint: step1000 — overall weighted eval accuracy: 0.710
Downloads · 30 days
3
14% of all-time downloads
All-time downloads
21
Public
Repo size
23 B
Likes
0
Public
Click a slice to open those files.
Other1.5 KB · 58%
From the Hugging Face model README
Best checkpoint selected from the training run by highest weighted eval accuracy across 15 benchmark categories. Selected checkpoint: step_1000 — overall weighted eval accuracy: 0.710
Detailed results for all 15 benchmark categories (scores at 3 decimal places):
| # | Benchmark | Eval Accuracy |
|---|---|---|
| 1 | Math Reasoning | 0.550 |
| 2 | Logical Reasoning | 0.819 |
| 3 | Code Generation | 0.650 |
| 4 | Question Answering | 0.607 |
| 5 | Reading Comprehension | 0.700 |
| 6 | Common Sense | 0.736 |
| 7 | Text Classification | 0.828 |
| 8 | Sentiment Analysis | 0.792 |
| 9 | Dialogue Generation | 0.644 |
| 10 | Summarization | 0.767 |
| 11 | Translation | 0.804 |
| 12 | Knowledge Retrieval | 0.676 |
| 13 | Creative Writing | 0.610 |
| 14 | Instruction Following | 0.758 |
| 15 | Safety Evaluation | 0.739 |
Overall weighted eval accuracy: 0.710
MIT