Downloads · 30 days
38
25% of all-time downloads
lab22-dpo-vn
Huanvg02/lab22-dpo-vn
lab22-dpo-vn is a machine learning model from Huanvg02. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
This repository contains a DPO-aligned version of Qwen2.5-3B, fine-tuned as part of the VinUni AICB program.
All-time downloads
154
Public
Repo size
5.3 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf5.2 GB · 97%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- May 8, 2026
- Updated
- May 8, 2026
- SHA
- 023f7dd6
Base models
Model card
From the Hugging Face model README
Lab 22: DPO Alignment - Vietnamese LLM
This repository contains a DPO-aligned version of Qwen2.5-3B, fine-tuned as part of the VinUni AICB program.
Model Details
- Base Model: unsloth/Qwen2.5-3B-bnb-4bit
- SFT Dataset: bkai-foundation-models/vi-alpaca
- Preference Dataset: argilla/ultrafeedback-binarized-preferences-cleaned
- DPO Hyperparameters: Beta=0.1, LR=5e-07
Quantization
Includes GGUF versions (Q4_K_M and Q8_0) for efficient inference with llama.cpp.
- License
- apache-2.0
- Created
- May 8, 2026
- Updated
- May 8, 2026