Downloads · 30 days
2
6% of all-time downloads
sadSD13213/my-awesome-model-step-1000
my-awesome-model-step-1000 is a feature extraction model from sadSD13213. Use it when you need embeddings to search or compare text. It is set up for transformers. The card lists the license as mit.
This model repository contains the best checkpoint selected from the workspace checkpoints based on the highest evaluation score / evalaccuracy-equivalent metric among available checkpoints.
Downloads · 30 days
2
6% of all-time downloads
All-time downloads
34
Public
Repo size
23 B
Likes
0
Public
Click a slice to open those files.
Other1.5 KB · 53%
From the Hugging Face model README
This model repository contains the best checkpoint selected from the workspace checkpoints based on the highest evaluation score / eval_accuracy-equivalent metric among available checkpoints.
checkpoints/step_10001000bertBertModelScores are reported to three decimal places for all 15 benchmark categories.
| Benchmark | eval_accuracy |
|---|---|
| math_reasoning | 0.550 |
| logical_reasoning | 0.819 |
| code_generation | 0.650 |
| question_answering | 0.607 |
| reading_comprehension | 0.700 |
| common_sense | 0.736 |
| text_classification | 0.828 |
| sentiment_analysis | 0.792 |
| dialogue_generation | 0.644 |
| summarization | 0.761 |
| translation | 0.728 |
| knowledge_retrieval | 0.649 |
| creative_writing | 0.827 |
| instruction_following | 0.625 |
| safety_evaluation | 0.793 |
The overall score uses the evaluation pipeline weights with slight emphasis on reasoning and related capability benchmarks.
config.jsonpytorch_model.binREADME.md