Downloads · 30 days
21
0% of all-time downloads
OPEN_SOLAR_KO_10.7B_DPO_Adapter_Attach
dddsaty/OPEN_SOLAR_KO_10.7B_DPO_Adapter_Attach
OPEN_SOLAR_KO_10.7B_DPO_Adapter_Attach is a text generation model from dddsaty. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
Explanation - With the base model, applied DPO to the small amount of layers with the open dataset , saved just the adapter part - Merged the base model and the tuned adapter together
All-time downloads
24.7K
Public
Parameters
10.9B
21.7 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors21.7 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- Jan 25, 2024
- Updated
- Feb 11, 2024
- SHA
- 313bf887
Model card
From the Hugging Face model README
Explanation
- With the base model, applied DPO to the small amount of layers with the open dataset , saved just the adapter part
- Merged the base model and the tuned adapter together
Base Model
Used Corpus
Score
| Average | Ko-ARC | Ko-HellaSwag | Ko-MMLU | Ko-TruthfulQA | Ko-CommonGen V2 |
|---|---|---|---|---|---|
| 52.83 | 50 | 60.55 | 48.8 | 71.51 | 43.65 |
Log
- 2024.01.25: Initial version Upload
- 2024.02.10: Readme updated
- 2024.02.11: Score updated
LICENSE
- Apache 2.0
Citation
- beomi/OPEN-SOLAR-KO-10.7B
@misc {solar_ko_junbum_2023, author = { {L. Junbum} }, title = { Solar-Ko-10.7b }, year = 2024, url = { https://huggingface.co/beomi/SOLAR-KO-10.7B }, publisher = { Hugging Face } }
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- apache-2.0
- Languages
- ko
- Created
- Jan 25, 2024
- Updated
- Feb 11, 2024