Downloads · 30 days
16
0% of all-time downloads
eeve_dpo-v3
ENERGY-DRINK-LOVE/eeve_dpo-v3
eeve_dpo-v3 is a text generation model from ENERGY-DRINK-LOVE. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
should probably proofread and complete it, then remove this comment. --
All-time downloads
38K
Public
Parameters
10.8B
21.6 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors21.6 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- Feb 27, 2024
- Updated
- Mar 7, 2024
- SHA
- dac78669
Try a prompt
Base models
Model card
From the Hugging Face model README
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->
ENERGY-DRINK-LOVE/eeve_dpo-v3
Our Team
- Jingyeom Kim
- Youjin Chung
Model
Base Model
Hardware and Software
- Hardware: A100 * 8 for training our model
- Deepspeed library & Huggingface TRL Trainer
Dataset
- DPO_dataset
- 자체 제작 dpo dataset(AI-hub dataset 활용)
- OpenOrca DPO 등 영어 데이터셋 번역(ENERGY-DRINK-LOVE/translate_share_gpt_dedup_llama_SFT_1024, 자체모델 활용)
Training Method
Benchmark
| Task | 0-shot | 5-shot |
|---|---|---|
| kobest_boolq | 0.950142 | 0.944444 |
| kobest_copa | 0.751 | 0.835 |
| kobest_hellaswag | 0.474 | 0.508 |
| kobest_sentineg | 0.811083 | 0.972292 |
| Average | 0.74655625 | 0.81493399 |
- (240307기준 7등) | Average | Ko-ARC | Ko-HellaSwag | Ko-MMLU | Ko-TruthfulQA | Ko-CommonGen V2 | | ------: | -----: | -----------: | ------: | ------------: | --------------: | | 57.97 | 57.51 | 67.01 | 56.3 | 54.86 | 54.19 |
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- apache-2.0
- Created
- Feb 27, 2024
- Updated
- Mar 7, 2024