Downloads · 30 days
2
1% of all-time downloads
Qwen1.5-0.5B-Chat-EPFL-cDPO
attention-avengers/Qwen1.5-0.5B-Chat-EPFL-cDPO
Qwen1.5-0.5B-Chat-EPFL-cDPO is a text generation model from attention-avengers. Use it when you need the model to write or continue text. It is set up for peft.
Qwen1.5-0.5B-Chat DPO fine-tuned on the dataset that consists of open-ended and multiple choice questions from different EPFL courses.
All-time downloads
260
Public
Repo size
15.2 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors15.2 MB · 57%
At a glance
- Task
- Text Generation
- Library
- peft
- Model type
- qwen2
- Access
- Public
- Created
- May 28, 2024
- Updated
- May 28, 2024
- SHA
- 5d46fe08
Try a prompt
Base models
Model card
From the Hugging Face model README
Qwen1.5-0.5B-Chat with EPFL DPO fine-tuning
Qwen1.5-0.5B-Chat DPO fine-tuned on the dataset that consists of open-ended and multiple choice questions from different EPFL courses.
Model Details
Model Description
The model was developed during the course Modern Natural Language Processing (CS-552). Its aim is to fine-tune the base model (Qwen/Qwen1.5-0.5B-Chat) to accurately answer open-ended and multiple-choice questions from various EPFL courses.
- Developed by: Emma Lise Boehly, Ahmed Aziz Ben Haj Hmida and Jan Kokla
- Finetuned from model: Qwen/Qwen1.5-0.5B-Chat
Training Details
Training Data
Training data is not publicly available.
Training Procedure
Training Hyperparameters
-
Training regime: cDPO with bf16 mixed precision, $\beta=0.2$, $lr=3 \times 10^{-6}$, and $label_smoothing=0.2$
-
PEFT 0.10.0
- Task
- Text Generation
- Library
- peft
- Type
- qwen2
- Languages
- en
- Created
- May 28, 2024
- Updated
- May 28, 2024