Downloads · 30 days
6
13% of all-time downloads
sapphia-410m-RM
Fizzarolli/sapphia-410m-RM
sapphia-410m-RM is a machine learning model from Fizzarolli. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft. The card lists the license as apache-2.0.
super duper ultra highly experimental lora finetune of EleutherAI/pythia-410m-deduped on argilla/dpo-mix-7k, to be a reward model.
All-time downloads
47
Public
Repo size
25.2 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors25.2 MB · 90%
At a glance
- Library
- peft
- License
- apache-2.0
- Access
- Public
- Created
- Apr 2, 2024
- Updated
- Apr 2, 2024
- SHA
- 280dacad
Base models
Datasets
Model card
From the Hugging Face model README
sapphia-410m-RM
super duper ultra highly experimental lora finetune of EleutherAI/pythia-410m-deduped on argilla/dpo-mix-7k, to be a reward model.
why?
nexusflow achieved good results with traditional reward model finetuning! why not meeeeeee :3
- Library
- peft
- License
- apache-2.0
- Created
- Apr 2, 2024
- Updated
- Apr 2, 2024