Downloads · 30 days
0
August4293/mistral_gsm8k_ssl_it2
mistral_gsm8k_ssl_it2 is a machine learning model from August4293. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers.
This model has been fine-tuned using the The Second Iteration of GSM8K Preference Dataset with the Direct Preference Optimization algorithm. The goal of this fine-tuning is to enhance the model's performance in solvin…
Downloads · 30 days
0
Access
Public
Updated Jul 4, 2024
Repo size
672 MB
Likes
0
Public
Click a slice to open those files.
.safetensors671 MB · 100%
From the Hugging Face model README
This model has been fine-tuned using the The Second Iteration of GSM8K Preference Dataset with the Direct Preference Optimization algorithm. The goal of this fine-tuning is to enhance the model's performance in solving arithmetic problems on the GSM8K benchmark.