Downloads · 30 days
2
5% of all-time downloads
SD12DSA21EAS/MyAwesomeModel-step1000
MyAwesomeModel-step1000 is a machine learning model from SD12DSA21EAS. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This model checkpoint was selected as the best performing model based on the highest overall evaluation accuracy across all benchmarks.
Downloads · 30 days
2
5% of all-time downloads
All-time downloads
40
Public
Repo size
23 B
Likes
0
Public
Click a slice to open those files.
Other1.5 KB · 50%
From the Hugging Face model README
This model checkpoint was selected as the best performing model based on the highest overall evaluation accuracy across all benchmarks.
step_1000eval_accuracy score across all checkpoints evaluatedAll scores formatted to 3 decimal places:
| Benchmark | Accuracy Score |
|---|---|
| Code Generation | 0.811 |
| Common Sense | 0.831 |
| Creative Writing | 0.846 |
| Dialogue Generation | 0.873 |
| Instruction Following | 0.884 |
| Knowledge Retrieval | 0.911 |
| Logical Reasoning | 0.927 |
| Math Reasoning | 0.948 |
| Question Answering | 0.969 |
| Reading Comprehension | 0.982 |
| Safety Evaluation | 0.999 |
| Sentiment Analysis | 0.999 |
| Summarization | 0.999 |
| Text Classification | 0.999 |
| Translation | 0.999 |
| Checkpoint | Overall Eval Accuracy |
|---|---|
| step_100 | 0.366 |
| step_200 | 0.431 |
| step_300 | 0.495 |
| step_400 | 0.560 |
| step_500 | 0.623 |
| step_600 | 0.688 |
| step_700 | 0.753 |
| step_800 | 0.818 |
| step_900 | 0.881 |
| step_1000 | 0.932 |
from transformers import AutoModel
model = AutoModel.from_pretrained("SD12DSA21EAS/MyAwesomeModel-step1000")
MIT