Downloads · 30 days
10
0% of all-time downloads
SOLAR-10.7B-dpo-v0.1
hyeogi/SOLAR-10.7B-dpo-v0.1
SOLAR-10.7B-dpo-v0.1 is a text generation model from hyeogi. Use it when you need the model to write or continue text. It is set up for transformers.
- Base Model: yanolja/KoSOLAR-10.7B-v0.1
All-time downloads
22.6K
Public
Parameters
10.9B
21.7 GB on disk
Likes
4
Public
Repo makeup
Click a slice to open those files.
.safetensors21.7 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- llama
- Access
- Public
- Created
- Dec 31, 2023
- Updated
- Jan 1, 2024
- SHA
- 1204a523
Model card
From the Hugging Face model README
SOLAR-10.7B
Model Details
- Base Model: yanolja/KoSOLAR-10.7B-v0.1
Datasets
- sampling and translate Open-Orca/SlimOrca
- sampling and translate Anthropic/hh-rlhf
Benchmark
- SOTA model as of Jan 1, 2024 (https://huggingface.co/spaces/upstage/open-ko-llm-leaderboard).
| Model | Average | Ko-ARC | Ko-HellaSwag | Ko-MMLU | Ko-TruthfulQA | Ko-CommonGen V2 |
|---|---|---|---|---|---|---|
| hyeogi/SOLAR-10.7B-dpo-v0.1 (Ours) | 56.29 | 47.95 | 59.49 | 51.29 | 60.97 | 61.75 |
| jeonsworld/CarbonVillain-10.7B-v1 | 55.33 | 49.91 | 60.65 | 55.04 | 48.22 | 62.81 |
| Megastudy/M-SOLAR-10.7B-v1.1-beta | 55.25 | 51.71 | 60.86 | 54.24 | 47.12 | 62.34 |
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- Languages
- ko
- Created
- Dec 31, 2023
- Updated
- Jan 1, 2024