Downloads · 30 days
13
16% of all-time downloads
exp29-dpo-epoch2
ogwata/exp29-dpo-epoch2
exp29-dpo-epoch2 is a text generation model from ogwata. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This model is a fine-tuned version of ogwata/exp21-sft-dpo-lr7e7-beta02 using Direct Preference Optimization (DPO) via the Unsloth library.
All-time downloads
80
Public
Parameters
4B
8.1 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors8 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- qwen3
- Access
- Public
- Created
- Feb 28, 2026
- Updated
- Feb 28, 2026
- SHA
- d0e4727e
Try a prompt
Base models
Datasets
Model card
From the Hugging Face model README
exp29-dpo-epoch2
This model is a fine-tuned version of ogwata/exp21-sft-dpo-lr7e7-beta02 using Direct Preference Optimization (DPO) via the Unsloth library.
This repository contains the full-merged 16-bit weights. No adapter loading is required.
Training Configuration
- Base model: ogwata/exp21-sft-dpo-lr7e7-beta02
- Method: DPO (Direct Preference Optimization)
- Epochs: 2
- Learning rate: 7e-07
- Beta: 0.2
- Max sequence length: 1024
- LoRA Config: r=8, alpha=16 (merged into base)
- Task
- Text Generation
- Library
- transformers
- Type
- qwen3
- License
- apache-2.0
- Languages
- en
- Created
- Feb 28, 2026
- Updated
- Feb 28, 2026