Downloads · 30 days
68
18% of all-time downloads
Neos-Gemma-2-9b
YeonwooSung/Neos-Gemma-2-9b
Neos-Gemma-2-9b is a text generation model from YeonwooSung. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
Gemma-2-9b model, finetuned with ORPO trainer
All-time downloads
379
Public
Parameters
9.2B
18.5 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors18.5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- gemma2
- Access
- Public
- Created
- Nov 11, 2024
- Updated
- Nov 12, 2024
- SHA
- 76e109f7
Try a prompt
Base models
Model card
From the Hugging Face model README
Model Card for Model ID
Gemma-2-9b model, finetuned with ORPO trainer
Training Procedure
Trained with ORPOTrainer with rsLoRA.
Dataset
Trained on mlabonne/orpo-dpo-mix-40k dataset.
Open LLM Leaderboard Evaluation Results
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 25.21 |
| IFEval (0-Shot) | 58.76 |
| BBH (3-Shot) | 35.64 |
| MATH Lvl 5 (4-Shot) | 8.23 |
| GPQA (0-shot) | 9.73 |
| MuSR (0-shot) | 5.79 |
| MMLU-PRO (5-shot) | 33.12 |
- Task
- Text Generation
- Library
- transformers
- Type
- gemma2
- License
- apache-2.0
- Languages
- en
- Created
- Nov 11, 2024
- Updated
- Nov 12, 2024