Downloads · 30 days
13
23% of all-time downloads
MNLP_M3_dpo_model
madhueb/MNLP_M3_dpo_model
MNLP_M3_dpo_model is a text generation model from madhueb. Use it when you need the model to write or continue text. It is set up for transformers.
- Developed by: Madeleine Hueber - Language(s) (NLP): English - License: For academic use only - Finetuned from model: Qwen3-0.6B-Base
All-time downloads
57
Public
Parameters
596M
2.4 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors2.4 GB · 99%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- qwen3
- Access
- Public
- Created
- Jun 10, 2025
- Updated
- Jun 10, 2025
- SHA
- d43297e4
Try a prompt
Datasets
Model card
From the Hugging Face model README
- Developed by: Madeleine Hueber
- Language(s) (NLP): English
- License: For academic use only
- Finetuned from model: Qwen3-0.6B-Base
This model is a preference-aligned language model fine-tuned for answering STEM-related instruction prompts. It was developed as part of the CS-552 course Modern Natural Language Processing at EPFL.
Training Details:
-
Stage 1: Instruction tuning on TIGER-Lab/WebInstruct-verified (200k data , aivalable on the instruction split of madhueb/MNLP_M3_dpo_dataset )
-
Stage 2: DPO fine-tuning using the default train split of madhueb/MNLP_M3_dpo_dataset.
- Task
- Text Generation
- Library
- transformers
- Type
- qwen3
- Created
- Jun 10, 2025
- Updated
- Jun 10, 2025