Downloads · 30 days
2
10% of all-time downloads
trainhubai/gpt-neo-1-3B-orpo
gpt-neo-1-3B-orpo is a machine learning model from trainhubai. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft.
This is a fine-tuned version of the GPT-Neo 1.3B model from EleutherAI, trained using ORPO (Odds Ratio Preference Optimization) on the 'mlabonne/orpo-dpo-mix-40k' dataset. It was fine-tuned with LoRA (Low-Rank Adaptat…
Downloads · 30 days
2
10% of all-time downloads
All-time downloads
20
Public
Repo size
12.6 MB
Likes
0
Public
Click a slice to open those files.
.safetensors12.6 MB · 72%
From the Hugging Face model README
This is a fine-tuned version of the GPT-Neo 1.3B model from EleutherAI, trained using ORPO (Odds Ratio Preference Optimization) on the 'mlabonne/orpo-dpo-mix-40k' dataset. It was fine-tuned with LoRA (Low-Rank Adaptation) to allow efficient training.
| Tasks | Version | Filter | n-shot | Metric | Value | Stderr | ||
|---|---|---|---|---|---|---|---|---|
| eq_bench | 2.1 | none | 0 | eqbench | ↑ | 3.9776 | ± | 1.7012 |
| none | 0 | percent_parseable | ↑ | 54.9708 | ± | 3.8158 |