Downloads · 30 days
0
August4293/mistral_self_alignment_SFT
mistral_self_alignment_SFT is a machine learning model from August4293. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers.
The Mistral 7b Self-Alignment SFT Model is an adapter fine-tuned specifically for self-alignment and harmlessness. It has been trained using the Mistral Self-Alignment Preference Dataset, which can be accessed here.
Downloads · 30 days
0
Access
Public
Updated Mar 18, 2024
Repo size
168 MB
Likes
0
Public
Click a slice to open those files.
.safetensors168 MB · 99%
From the Hugging Face model README
The Mistral 7b Self-Alignment SFT Model is an adapter fine-tuned specifically for self-alignment and harmlessness. It has been trained using the Mistral Self-Alignment Preference Dataset, which can be accessed here.
The fine-tuning process is detailed on the corresponding GitHub page, providing insights into the methodology and purpose behind the model's adaptation.