Downloads · 30 days
79
0% of all-time downloads
fblgit/UNA-POLAR-10.7B-InstructMath-v2
UNA-POLAR-10.7B-InstructMath-v2 is a text generation model from fblgit. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-nc-nd-4.0.
Its a UNA version with DPO over MathPILE Books out of the UNA-SOLAR-10.7B-Instruct-1.0
Downloads · 30 days
79
0% of all-time downloads
All-time downloads
36.3K
Public
Parameters
10.7B
21.5 GB on disk
Likes
5
Public
Click a slice to open those files.
.safetensors21.5 GB · 100%
From the Hugging Face model README
Its a UNA version with DPO over MathPILE Books out of the UNA-SOLAR-10.7B-Instruct-1.0
I used MathPILE OUTSTANDING Dataset of great Mathematic material in order to produce this beautiful model :)
If your model has inside UNA technology, cite.
UNA-DPO over Attention and MLP's
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 74.07 |
| AI2 Reasoning Challenge (25-Shot) | 70.73 |
| HellaSwag (10-Shot) | 88.20 |
| MMLU (5-Shot) | 66.03 |
| TruthfulQA (0-shot) | 71.73 |
| Winogrande (5-shot) | 82.95 |
| GSM8k (5-shot) | 64.75 |