Downloads · 30 days
5
5% of all-time downloads
exp43-dpo-on-exp40
ogwata/exp43-dpo-on-exp40
exp43-dpo-on-exp40 is a text generation model from ogwata. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This model is a fine-tuned version of ogwata/exp40-lr1e5-wd01-merged using Direct Preference Optimization (DPO) via the Unsloth library.
All-time downloads
91
Public
Parameters
4B
8.1 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors8 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- qwen3
- Access
- Public
- Created
- Mar 1, 2026
- Updated
- Mar 1, 2026
- SHA
- 44753c22
Try a prompt
Base models
Datasets
Model card
From the Hugging Face model README
exp43-dpo-on-exp40
This model is a fine-tuned version of ogwata/exp40-lr1e5-wd01-merged using Direct Preference Optimization (DPO) via the Unsloth library.
This repository contains the full-merged 16-bit weights. No adapter loading is required.
Training Configuration
- Base model: ogwata/exp40-lr1e5-wd01-merged
- Method: DPO (Direct Preference Optimization)
- Epochs: 1
- Learning rate: 7e-07
- Beta: 0.2
- Max sequence length: 1024
- LoRA Config: r=8, alpha=16 (merged into base)
- Task
- Text Generation
- Library
- transformers
- Type
- qwen3
- License
- apache-2.0
- Languages
- en
- Created
- Mar 1, 2026
- Updated
- Mar 1, 2026