Downloads · 30 days
7
12% of all-time downloads
Qwen2.5-0.5B-NLP-Project-2
emibrahim/Qwen2.5-0.5B-NLP-Project-2
Qwen2.5-0.5B-NLP-Project-2 is a text generation model from emibrahim. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This model is a fine-tuned version of Qwen2.5-0.5B-Instruct optimized for strict instruction-following and concise, human-aligned responses. It was trained using a two-stage alignment pipeline:
All-time downloads
59
Public
Parameters
494M
1000 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors988 MB · 99%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- qwen2
- Access
- Public
- Created
- Jun 5, 2026
- Updated
- Jun 5, 2026
- SHA
- 0dc7df67
Try a prompt
Base models
Model card
From the Hugging Face model README
Uploaded finetuned model
This model is a fine-tuned version of Qwen2.5-0.5B-Instruct optimized for strict instruction-following and concise, human-aligned responses. It was trained using a two-stage alignment pipeline:
Supervised Fine-Tuning (SFT): Trained on the HuggingFaceH4/no_robots dataset to improve structural formatting and zero-shot task execution.
Direct Preference Optimization (DPO): Aligned using the argilla/dpo-mix-7k dataset to reduce conversational verbosity and prioritize helpful, direct answers.
The model utilizes PEFT/LoRA adapters and was trained efficiently within memory constraints using the Unsloth framework.
This qwen2 model was trained 2x faster with Unsloth and Huggingface's TRL library.
- Task
- Text Generation
- Library
- transformers
- Type
- qwen2
- License
- apache-2.0
- Languages
- en
- Created
- Jun 5, 2026
- Updated
- Jun 5, 2026