Downloads · 30 days
21
14% of all-time downloads
mistral-orpo-mix
alvarobartt/mistral-orpo-mix
mistral-orpo-mix is a text generation model from alvarobartt. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
All-time downloads
147
Public
Parameters
7.2B
14.5 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors14.5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- mistral
- Access
- Public
- Created
- Mar 24, 2024
- Updated
- Mar 24, 2024
- SHA
- f8d82039
Try a prompt
Base models
Model card
From the Hugging Face model README
ORPO fine-tune of Mistral 7B v0.1 with DPO Mix 7K
Stable Diffusion XL "A capybara, a killer whale, and a robot named Ultra being friends"
This is an ORPO fine-tune of mistralai/Mistral-7B-v0.1 with
alvarobartt/dpo-mix-7k-simplified.
⚠️ Note that the code is still experimental, as the ORPOTrainer PR is still not merged, follow its progress
at 🤗trl - ORPOTrainer PR.
Reference
ORPO: Monolithic Preference Optimization without Reference Model
- Task
- Text Generation
- Library
- transformers
- Type
- mistral
- License
- apache-2.0
- Languages
- en
- Created
- Mar 24, 2024
- Updated
- Mar 24, 2024