janskyy

qwen3-4b-ultrafeedback-dpo

janskyy/qwen3-4b-ultrafeedback-dpo

qwen3-4b-ultrafeedback-dpo is a machine learning model from janskyy. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.

- Developed by: janskyy - License: apache-2.0 - Finetuned from model : unsloth/Qwen3-1.7B-Base-unsloth-bnb-4bit