Downloads · 30 days
72
1% of all-time downloads
FusionNet_7Bx2_MoE_Ko_DPO_Adapter_Attach
dddsaty/FusionNet_7Bx2_MoE_Ko_DPO_Adapter_Attach
FusionNet_7Bx2_MoE_Ko_DPO_Adapter_Attach is a text generation model from dddsaty. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
Explanation - With the base model, attached the DPO applied Adapter
All-time downloads
11.3K
Public
Parameters
12.9B
25.8 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors25.8 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- mit
- Model type
- mixtral
- Access
- Public
- Created
- Feb 13, 2024
- Updated
- Feb 14, 2024
- SHA
- 8063c4af
Try a prompt
Model card
From the Hugging Face model README
Explanation
- With the base model, attached the DPO applied Adapter
Base Model
Adapter Base Model
Adapter Corpus
Score
| Average | ARC | HellaSwag | MMLU | TruthfulQA | Winogrande | GSM8K |
|---|---|---|---|---|---|---|
| 76.09 | 73.89 | 88.94 | 65.03 | 71.24 | 87.61 | 69.83 |
Log
- 2024.02.13: Initial version Upload
LICENSE
- MIT
- Task
- Text Generation
- Library
- transformers
- Type
- mixtral
- License
- mit
- Languages
- en, ko
- Created
- Feb 13, 2024
- Updated
- Feb 14, 2024