wzhouad

gemma-2-9b-it-WPO-FP

wzhouad/gemma-2-9b-it-WPO-FP

gemma-2-9b-it-WPO-FP is a text generation model from wzhouad. Use it when you need the model to write or continue text. It is set up for transformers.

Gemma-2-9b-it model finetuned by off-policy WPO. Details in WPO: Enhancing RLHF with Weighted Preference Optimization.