Downloads · 30 days
53
100% of all-time downloads
DSACT1HJ46A/MyAwesomeModel
MyAwesomeModel is a feature extraction model from DSACT1HJ46A. Use it when you need embeddings to search or compare text. It is set up for transformers. The card lists the license as mit.
This repository contains the best checkpoint selected from the ten checkpoints found in the workspace (step100 through step1000).
Downloads · 30 days
53
100% of all-time downloads
All-time downloads
53
Public
Repo size
23 B
Likes
0
Public
Click a slice to open those files.
.md1.6 KB · 38%
From the Hugging Face model README
This repository contains the best checkpoint selected from the ten checkpoints found in the workspace (step_100 through step_1000).
step_1000eval_accuracy among all discovered checkpointseval_accuracy: 0.828| Checkpoint | eval_accuracy |
|---|---|
step_100 | 0.517 |
step_200 | 0.603 |
step_300 | 0.667 |
step_400 | 0.714 |
step_500 | 0.750 |
step_600 | 0.776 |
step_700 | 0.795 |
step_800 | 0.809 |
step_900 | 0.820 |
step_1000 | 0.828 |
All scores are reported to three decimal places.
| Benchmark | Score |
|---|---|
| Math Reasoning | 0.550 |
| Logical Reasoning | 0.819 |
| Common Sense | 0.736 |
| Reading Comprehension | 0.700 |
| Question Answering | 0.607 |
Text Classification (eval_accuracy) | 0.828 |
| Sentiment Analysis | 0.792 |
| Code Generation | 0.650 |
| Creative Writing | 0.610 |
| Dialogue Generation | 0.644 |
| Summarization | 0.767 |
| Translation | 0.804 |
| Knowledge Retrieval | 0.676 |
| Instruction Following | 0.758 |
| Safety Evaluation | 0.739 |
Full selection metadata is provided in evaluation_results.json.
config.json — model configuration from step_1000pytorch_model.bin — model weights from step_1000evaluation_results.json — checkpoint accuracies and evaluation resultsMIT