Downloads · 30 days
117
0% of all-time downloads
Undi95/MM-ReMM-L2-20B
MM-ReMM-L2-20B is a text generation model from Undi95. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-nc-4.0.
Downloads · 30 days
117
0% of all-time downloads
All-time downloads
50.1K
Public
Parameters
20B
40.3 GB on disk
Likes
3
Public
Click a slice to open those files.
.safetensors40.3 GB · 100%
How the weights are stored.
F1610B · 50%
From the Hugging Face model README
Merge:
layer_slices:
- model: Gryphe/MythoMax-L2-13b
start: 0
end: 16
- model: Undi95/MM-ReMM-L2-20B-Part1
start: 8
end: 20
- model: Gryphe/MythoMax-L2-13b
start: 17
end: 32
- model: Undi95/MM-ReMM-L2-20B-Part1
start: 21
end: 40
<!-- description start -->
Part1 = ReMM v2.1 merged /w MythoMax low weight to keep consistency. I call this "dilution" and result show consistency and coherency without repeat/loop beside the small amount of duplicated datas.
Below is an instruction that describes a task. Write a response that completes the request.
### Instruction:
{prompt}
### Response:
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 51.14 |
| ARC (25-shot) | 60.84 |
| HellaSwag (10-shot) | 85.18 |
| MMLU (5-shot) | 56.45 |
| TruthfulQA (0-shot) | 53.33 |
| Winogrande (5-shot) | 75.77 |
| GSM8K (5-shot) | 7.73 |
| DROP (3-shot) | 18.66 |