Downloads · 30 days
11
0% of all-time downloads
komt_DPOv3
ENERGY-DRINK-LOVE/komt_DPOv3
komt_DPOv3 is a text generation model from ENERGY-DRINK-LOVE. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-4.0.
All-time downloads
17K
Public
Parameters
10.9B
21.7 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors21.7 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- cc-by-4.0
- Model type
- llama
- Access
- Public
- Created
- Mar 11, 2024
- Updated
- Mar 16, 2024
- SHA
- b5d9eca4
Try a prompt
Base models
Model card
From the Hugging Face model README
ENERGY-DRINK-LOVE/komt_DPOv3
Our Team
- Youjin Chung
- Jingyeom Kim
Model
Base Model
Hardware and Software
- Hardware: A100 * 8 for training our model
- Deepspeed library & Huggingface TRL Trainer
Dataset
- DPO_dataset
- 자체 제작 dpo dataset(AI-hub dataset 활용)
- OpenOrca DPO 등 영어 데이터셋 번역(ENERGY-DRINK-LOVE/translate_share_gpt_dedup_llama_SFT_1024, 자체모델 활용)
Training Method
Benchmark
- (240316기준 4등)
| Average | Ko-ARC | Ko-HellaSwag | Ko-MMLU | Ko-TruthfulQA | Ko-CommonGen V2 |
|---|---|---|---|---|---|
| 61.20 | 57.51 | 70.33 | 53.34 | 68.49 | 56.32 |
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- cc-by-4.0
- Created
- Mar 11, 2024
- Updated
- Mar 16, 2024