Downloads · 30 days
62
1% of all-time downloads
Llama3.1-Gutenberg-Doppel-70B
nbeerbower/Llama3.1-Gutenberg-Doppel-70B
Llama3.1-Gutenberg-Doppel-70B is a text generation model from nbeerbower. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama3.1.
All-time downloads
6.8K
Public
Parameters
70.6B
141 GB on disk
Likes
6
Public
Repo makeup
Click a slice to open those files.
.safetensors141 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- llama3.1
- Model type
- llama
- Access
- Public
- Created
- Oct 11, 2024
- Updated
- Oct 16, 2024
- SHA
- f083f3a8
Try a prompt
Base models
Model card
From the Hugging Face model README
Llama3.1-Gutenberg-Doppel-70B
mlabonne/Hermes-3-Llama-3.1-70B-lorablated finetuned on jondurbin/gutenberg-dpo-v0.1 and nbeerbower/gutenberg2-dpo.
Method
ORPO tuned with 2x H100 for 3 epochs.
Thank you Schneewolf Labs for the compute.
Open LLM Leaderboard Evaluation Results
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 35.68 |
| IFEval (0-Shot) | 70.92 |
| BBH (3-Shot) | 52.56 |
| MATH Lvl 5 (4-Shot) | 13.75 |
| GPQA (0-shot) | 12.64 |
| MuSR (0-shot) | 22.68 |
| MMLU-PRO (5-shot) | 41.52 |
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- llama3.1
- Featherless Ai
- live
- Created
- Oct 11, 2024
- Updated
- Oct 16, 2024