Downloads · 30 days
84
6% of all-time downloads
dddsaty_-_OPEN_SOLAR_KO_10.7B_DPO_Adapter_Attach-gguf
RichardErkhov/dddsaty_-_OPEN_SOLAR_KO_10.7B_DPO_Adapter_Attach-gguf
dddsaty_-_OPEN_SOLAR_KO_10.7B_DPO_Adapter_Attach-gguf is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
All-time downloads
1.3K
Public
Repo size
123 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf143 GB · 100%
At a glance
- Access
- Public
- Created
- Jul 29, 2024
- Updated
- Jul 30, 2024
- SHA
- 390e77a9
Model card
From the Hugging Face model README
Quantization made by Richard Erkhov.
OPEN_SOLAR_KO_10.7B_DPO_Adapter_Attach - GGUF
- Model creator: https://huggingface.co/dddsaty/
- Original model: https://huggingface.co/dddsaty/OPEN_SOLAR_KO_10.7B_DPO_Adapter_Attach/
Original model description:
license: apache-2.0 language:
- ko library_name: transformers pipeline_tag: text-generation datasets:
- maywell/ko_Ultrafeedback_binarized
Explanation
- With the base model, applied DPO to the small amount of layers with the open dataset , saved just the adapter part
- Merged the base model and the tuned adapter together
Base Model
Used Corpus
Score
| Average | Ko-ARC | Ko-HellaSwag | Ko-MMLU | Ko-TruthfulQA | Ko-CommonGen V2 |
|---|---|---|---|---|---|
| 52.83 | 50 | 60.55 | 48.8 | 71.51 | 43.65 |
Log
- 2024.01.25: Initial version Upload
- 2024.02.10: Readme updated
- 2024.02.11: Score updated
LICENSE
- Apache 2.0
Citation
- beomi/OPEN-SOLAR-KO-10.7B
@misc {solar_ko_junbum_2023, author = { {L. Junbum} }, title = { Solar-Ko-10.7b }, year = 2024, url = { https://huggingface.co/beomi/SOLAR-KO-10.7B }, publisher = { Hugging Face } }
- Created
- Jul 29, 2024
- Updated
- Jul 30, 2024