Downloads · 30 days
2
1% of all-time downloads
MedMerge-6-7b-alpha-dpo
Technoculture/MedMerge-6-7b-alpha-dpo
MedMerge-6-7b-alpha-dpo is a machine learning model from Technoculture. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for adapter-transformers. The card lists the license as mit.
All-time downloads
204
Public
Repo size
640 MB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.safetensors640 MB · 99%
At a glance
- Library
- adapter-transformers
- License
- mit
- Model type
- llama
- Access
- Public
- Created
- Feb 5, 2024
- Updated
- Feb 9, 2024
- SHA
- 83b32dcb
Base models
Model card
From the Hugging Face model README
Technoculture/MedMerge-6-7b-alpha-dpo
Open LLM Leaderboard
| Model Name | ARC | HellaSwag | MMLU | TruthfulQA | Winogrande | GSM8K |
|---|---|---|---|---|---|---|
| Orca-2-7b | 78.4 | 76.1 | 53.7 | 52.4 | 74.2 | 47.2 |
| LLAMA-2-7b | 43.2 | 77.1 | 44.4 | 38.7 | 69.5 | 16 |
| MT7Bi-sft | 54.1 | 75.11 | - | 43.08 | 72.14 | 15.54 |
| MedMerge-6-7b | 29.52 | 41.04 | - | 37.53 | 59.35 | 0.91 |
| MedMerge-6-7b-alpha-dpo | 54.27 | 75.6 | 52.65 | 43.94 | 71.03 | 26.16 |
Training Details
- GPU: Nvidia A100 Tensor Core GPU
- Total Batches: 4266
- Epochs: 3
- Duration: 3 hours, 57 minutes, and 00 seconds
DPO Training Dataset Mixture
| Dataset Name | Original Size(Rows) | Ratio | Size After Ratio(Rows) |
|---|---|---|---|
| argilla/distilabel-math-preference-dpo | 2.4k | 1.0 | 2.4k |
| argilla/distilabel-intel-orca-dpo-pairs | 12.9k | 0.5 | 6.45k |
| jondurbin/truthy-dpo-v0.1 | 1.04k | 1.0 | 1.04k |
| argilla/distilabel-capybara-dpo-7k-binarized | 7.5k | 0.2 | 1.5k |
| Total Size: 11.38k |
Training Loss Plot
Training Loss Smoothed Plot
For full details of this dpo-training please read our notebook.
<a target="_blank" href="https://colab.research.google.com/github/dkshjn/Technoculture/blob/main/MedMerge_6_7b_alpha_dpo.ipynb"> <img src="https://colab.research.google.com/assets/colab-badge.svg" alt="Open In Colab"/> </a>- Library
- adapter-transformers
- Type
- llama
- License
- mit
- Languages
- en
- Created
- Feb 5, 2024
- Updated
- Feb 9, 2024