Downloads · 30 days
55
10% of all-time downloads
zariness00/smolk12_dpo
smolk12_dpo is a text generation model from zariness00. Use it when you need the model to write or continue text.
This model is finetuned version of HuggingFaceTB/SmolLM2-360M-Instruct. It has been trained using TRL.
Downloads · 30 days
55
10% of all-time downloads
All-time downloads
559
Public
Parameters
362M
1.4 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors1.4 GB · 100%
From the Hugging Face model README
This model is finetuned version of HuggingFaceTB/SmolLM2-360M-Instruct. It has been trained using TRL.
Quick start
Training procedure
The model was trained with DPO