Downloads · 30 days
5
2% of all-time downloads
wh-zhu/Qwen2.5-7B-PSFT-RL-DAPO-90
Qwen2.5-7B-PSFT-RL-DAPO-90 is a text generation model from wh-zhu. Use it when you need the model to write or continue text. It is set up for transformers.
This repository contains the weights for the model described in the paper Hybrid Policy Distillation for LLMs.
Downloads · 30 days
5
2% of all-time downloads
All-time downloads
307
Public
Parameters
7.6B
15.2 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors15.2 GB · 100%
From the Hugging Face model README
This repository contains the weights for the model described in the paper Hybrid Policy Distillation for LLMs.
Hybrid Policy Distillation (HPD) is a framework for compressing large language models (LLMs) that reformulates knowledge distillation (KD) as a reweighted log-likelihood objective at the token level. It integrates the complementary advantages of forward and reverse KL to balance mode coverage and mode-seeking, demonstrating improved computational efficiency and final performance across diverse model families and scales.
If you find this work useful in your research, please cite:
@article{hong2024hybrid,
title={Hybrid Policy Distillation for LLMs},
author={Hong, Zhiwei and others},
journal={arXiv preprint arXiv:2604.20244},
year={2024}
}