Downloads · 30 days
16
0% of all-time downloads
KoSOLAR-10.7B_DPO_Adapter_Attach
dddsaty/KoSOLAR-10.7B_DPO_Adapter_Attach
KoSOLAR-10.7B_DPO_Adapter_Attach is a text generation model from dddsaty. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
Explanation - With the base model, applied DPO to the small amount of layers with the open dataset , saved the adapter part - Attached the base model and the tuned adapter together
All-time downloads
17.7K
Public
Parameters
10.8B
21.6 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors21.6 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- Feb 13, 2024
- Updated
- Mar 5, 2024
- SHA
- 2894a5c2
Model card
From the Hugging Face model README
Explanation
- With the base model, applied DPO to the small amount of layers with the open dataset , saved the adapter part
- Attached the base model and the tuned adapter together
Base Model
Used Corpus
Score
| Average | Ko-ARC | Ko-HellaSwag | Ko-MMLU | Ko-TruthfulQA | Ko-CommonGen V2 |
|---|---|---|---|---|---|
| 56.24 | 53.33 | 64.36 | 55.63 | 45.42 | 62.46 |
Log
- 2024.02.13: Initial version Upload
LICENSE
- Apache 2.0
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- apache-2.0
- Languages
- ko
- Created
- Feb 13, 2024
- Updated
- Mar 5, 2024