Downloads · 30 days
7
13% of all-time downloads
sdsfsfsf3435/MyAwesomeModel-best-checkpoint
MyAwesomeModel-best-checkpoint is a feature extraction model from sdsfsfsf3435. Use it when you need embeddings to search or compare text. It is set up for transformers. The card lists the license as mit.
Selected checkpoint: checkpoints/step1000.
Downloads · 30 days
7
13% of all-time downloads
All-time downloads
53
Public
Repo size
23 B
Likes
0
Public
Click a slice to open those files.
.md2.7 KB · 62%
From the Hugging Face model README
Selected checkpoint: checkpoints/step_1000.
Selection basis: highest eval_accuracy, mapped in the workspace evaluation logic to text_classification_score.
Best eval_accuracy: 0.828.
Scores are computed from the workspace evaluation logic and rounded to 3 decimal places.
| Checkpoint | math_reasoning | code_generation | text_classification | sentiment_analysis | question_answering | logical_reasoning | common_sense | reading_comprehension | dialogue_generation | summarization | translation | knowledge_retrieval | creative_writing | instruction_following | safety_evaluation |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| step_100 | 0.345 | 0.350 | 0.517 | 0.617 | 0.475 | 0.319 | 0.530 | 0.475 | 0.438 | 0.517 | 0.640 | 0.529 | 0.328 | 0.550 | 0.628 |
| step_200 | 0.383 | 0.421 | 0.603 | 0.675 | 0.510 | 0.375 | 0.583 | 0.529 | 0.493 | 0.600 | 0.700 | 0.570 | 0.388 | 0.610 | 0.650 |
| step_300 | 0.415 | 0.475 | 0.667 | 0.710 | 0.533 | 0.445 | 0.621 | 0.569 | 0.530 | 0.650 | 0.733 | 0.596 | 0.436 | 0.650 | 0.668 |
| step_400 | 0.443 | 0.517 | 0.714 | 0.733 | 0.550 | 0.525 | 0.650 | 0.600 | 0.557 | 0.683 | 0.755 | 0.615 | 0.475 | 0.679 | 0.683 |
| step_500 | 0.467 | 0.550 | 0.750 | 0.750 | 0.564 | 0.605 | 0.672 | 0.625 | 0.579 | 0.707 | 0.769 | 0.631 | 0.507 | 0.700 | 0.696 |
| step_600 | 0.487 | 0.577 | 0.776 | 0.762 | 0.575 | 0.675 | 0.690 | 0.645 | 0.596 | 0.725 | 0.780 | 0.643 | 0.534 | 0.717 | 0.707 |
| step_700 | 0.506 | 0.600 | 0.795 | 0.772 | 0.584 | 0.731 | 0.705 | 0.663 | 0.611 | 0.739 | 0.788 | 0.653 | 0.557 | 0.730 | 0.717 |
| step_800 | 0.522 | 0.619 | 0.809 | 0.780 | 0.593 | 0.773 | 0.717 | 0.677 | 0.624 | 0.750 | 0.795 | 0.662 | 0.577 | 0.741 | 0.725 |
| step_900 | 0.537 | 0.636 | 0.820 | 0.786 | 0.600 | 0.801 | 0.727 | 0.689 | 0.634 | 0.759 | 0.800 | 0.670 | 0.595 | 0.750 | 0.732 |
| step_1000 (best) | 0.550 | 0.650 | 0.828 | 0.792 | 0.607 | 0.819 | 0.736 | 0.700 | 0.644 | 0.767 | 0.804 | 0.676 | 0.610 | 0.758 | 0.739 |
| Benchmark | Score |
|---|---|
| math_reasoning | 0.550 |
| code_generation | 0.650 |
| text_classification | 0.828 |
| sentiment_analysis | 0.792 |
| question_answering | 0.607 |
| logical_reasoning | 0.819 |
| common_sense | 0.736 |
| reading_comprehension | 0.700 |
| dialogue_generation | 0.644 |
| summarization | 0.767 |
| translation | 0.804 |
| knowledge_retrieval | 0.676 |
| creative_writing | 0.610 |
| instruction_following | 0.758 |
| safety_evaluation | 0.739 |