Downloads · 30 days
15
0% of all-time downloads
nox_DPOv3
ENERGY-DRINK-LOVE/nox_DPOv3
nox_DPOv3 is a text generation model from ENERGY-DRINK-LOVE. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
should probably proofread and complete it, then remove this comment. --
All-time downloads
36.1K
Public
Parameters
10.7B
21.5 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors21.5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- Mar 25, 2024
- Updated
- Mar 26, 2024
- SHA
- b83a769f
Try a prompt
Base models
Model card
From the Hugging Face model README
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->
nhn_dpo_v3_nox-solar-10.7b-v4_DPO
Our Team
- Youjin Chung
- Jingyeom Kim
Model
Base Model
Hardware and Software
- Hardware: A100 * 8 for training our model
- Deepspeed library & Huggingface TRL Trainer
Dataset
- DPO_dataset
- 자체 제작 dpo dataset(AI-hub dataset 활용)
- OpenOrca DPO 등 영어 데이터셋 번역(ENERGY-DRINK-LOVE/translate_share_gpt_dedup_llama_SFT_1024, 자체모델 활용)
Training Method
Benchmark
0 shot (macro f1)
| kobest_boolq | kobest_copa | kobest_hellaswag | kobest_sentineg |
|---|---|---|---|
| 0.931613 | 0.740751 | 0.468602 | 0.488465 |
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- apache-2.0
- Featherless Ai
- live
- Created
- Mar 25, 2024
- Updated
- Mar 26, 2024