Downloads · 30 days
82
30% of all-time downloads
afaji/fresh-2-layer-medmcqa10000-distill-of-fresh-2-layer-mmlu_EVAL_mmlu
fresh-2-layer-medmcqa10000-distill-of-fresh-2-layer-mmlu_EVAL_mmlu is a multiple choice model from afaji. Use it for the multiple choice task on the model card, and read the license before you ship it in a product. It is set up for transformers.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
82
30% of all-time downloads
All-time downloads
274
Public
Repo size
196 MB
Likes
0
Public
Click a slice to open those files.
.bin98.3 MB · 99%
From the Hugging Face model README
This model is a fine-tuned version of on an unknown dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | Accuracy |
|---|---|---|---|---|
| No log | 0.32 | 100 | 200.8704 | 0.264 |
| No log | 0.64 | 200 | 196.7610 | 0.376 |
| No log | 0.96 | 300 | 208.2900 | 0.39 |
| No log | 1.28 | 400 | 191.1668 | 0.382 |
| 139.6607 | 1.6 | 500 | 200.9705 | 0.398 |
| 139.6607 | 1.92 | 600 | 189.0896 | 0.406 |
| 139.6607 | 2.24 | 700 | 185.7183 | 0.41 |
| 139.6607 | 2.56 | 800 | 174.6011 | 0.426 |
| 139.6607 | 2.88 | 900 | 186.1249 | 0.422 |
| 79.571 | 3.19 | 1000 | 185.1113 | 0.424 |
| 79.571 | 3.51 | 1100 | 181.1421 | 0.398 |
| 79.571 | 3.83 | 1200 | 186.5035 | 0.412 |
| 79.571 | 4.15 | 1300 | 184.2203 | 0.432 |
| 79.571 | 4.47 | 1400 | 189.4636 | 0.396 |
| 56.051 | 4.79 | 1500 | 188.4894 | 0.412 |
| 56.051 | 5.11 | 1600 | 190.0390 | 0.43 |
| 56.051 | 5.43 | 1700 | 191.3842 | 0.416 |
| 56.051 | 5.75 | 1800 | 195.1680 | 0.406 |