Downloads · 30 days
5
9% of all-time downloads
tomasdrenik/tomasdrenik-gpt-neo-1.3B
tomasdrenik-gpt-neo-1.3B is a text generation model from tomasdrenik. Use it when you need the model to write or continue text. It is set up for transformers.
This is a fine-tuned version of the GPT-Neo 1.3B model from EleutherAI, trained using ORPO (Odds Ratio Preference Optimization) on the 'mlabonne/orpo-dpo-mix-40k' dataset. It was fine-tuned with LoRA (Low-Rank Adaptat…
Downloads · 30 days
5
9% of all-time downloads
All-time downloads
56
Public
Parameters
1.3B
5.3 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors5.3 GB · 100%
From the Hugging Face model README
This is a fine-tuned version of the GPT-Neo 1.3B model from EleutherAI, trained using ORPO (Odds Ratio Preference Optimization) on the 'mlabonne/orpo-dpo-mix-40k' dataset. It was fine-tuned with LoRA (Low-Rank Adaptation) to allow efficient training.
| Tasks | Version | Filter | n-shot | Metric | Value | Stderr | ||
|---|---|---|---|---|---|---|---|---|
| hellaswag | 1 | none | 0 | acc | ↑ | 0.3859 | ± | 0.0049 |
| none | 0 | acc_norm | ↑ | 0.4891 | ± | 0.0050 |