Downloads · 30 days
4
20% of all-time downloads
hyeogi_-_Yi-6b-dpo-v0.2-4bits
RichardErkhov/hyeogi_-_Yi-6b-dpo-v0.2-4bits
hyeogi_-_Yi-6b-dpo-v0.2-4bits is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
All-time downloads
20
Public
Parameters
6.3B
4.4 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors4.4 GB · 100%
Parameter types
How the weights are stored.
U85.5B · 88%
Model card
From the Hugging Face model README
Quantization made by Richard Erkhov.
Yi-6b-dpo-v0.2 - bnb 4bits
- Model creator: https://huggingface.co/hyeogi/
- Original model: https://huggingface.co/hyeogi/Yi-6b-dpo-v0.2/
Original model description:
language:
- ko pipeline_tag: text-generation tags:
- Yi
- dpo
Yi-6b-dpo
Model Details
- Base Model: beomi/Yi-Ko-6B
Datasets
- sampling and translate Open-Orca/SlimOrca
- sampling and translate Anthropic/hh-rlhf
Benchmark
- SOTA model under 7B as of Dec 20, 2023 (https://huggingface.co/spaces/upstage/open-ko-llm-leaderboard).
| Model | Average | Ko-ARC | Ko-HellaSwag | Ko-MMLU | Ko-TruthfulQA | Ko-CommonGen V2 |
|---|---|---|---|---|---|---|
| hyeogi/Yi-6b-dpo-v0.2 (Ours) | 52.63 | 41.72 | 52.96 | 46.69 | 52.38 | 69.42 |
| hyeogi/Yi-6b-dpo-v0.1(Ours) | 51.38 | 41.3 | 52.23 | 45.34 | 54.03 | 63.99 |
| Minirecord/Mini_DPO_7b_01 | 50.47 | 48.29 | 54.68 | 46.7 | 47.78 | 54.9 |
- Type
- llama
- Created
- Oct 30, 2024
- Updated
- Oct 30, 2024