Downloads · 30 days
0
OPD-mengrui
danqiao-cuhk/OPD-mengrui
OPD-mengrui is a machine learning model from danqiao-cuhk. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft. The card lists the license as other.
This repository contains three PEFT/LoRA adapter checkpoints from OPD distillation experiments.
Access
Public
Updated Jun 29, 2026
Repo size
1.6 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors1.6 GB · 97%
At a glance
- Library
- peft
- License
- other
- Access
- Public
- Created
- Jun 29, 2026
- Updated
- Jun 29, 2026
- SHA
- 84e2f7b2
Model card
From the Hugging Face model README
OPD Distill Adapters
This repository contains three PEFT/LoRA adapter checkpoints from OPD distillation experiments.
Checkpoints
forward_kl/: forward KL setting. This is the same-date bs80 rerun because the bs64 forward KL run did not save a checkpoint.reverse_kl/: reverse KL on-policy bs64/ga2 setting.entropy_js/: entropy JS on-policy bs64/ga2 setting.
Each subdirectory contains an adapter checkpoint with tokenizer files and PEFT adapter config.
Source Runs
forward_kl:test_opd_distill_verl_forward_kl_onpolicy_bs80_ga2_qwen3_8b_to_4b_8gpu_h200shared_cephonly_20260610_1055reverse_kl:test_opd_distill_verl_reverse_kl_onpolicy_bs64_ga2_qwen3_8b_to_4b_8gpu_h200shared_cephonly_20260610_1905entropy_js:test_opd_distill_verl_entropy_js_onpolicy_bs64_ga2_qwen3_8b_to_4b_8gpu_h200shared_cephonly_20260610_1905
- Library
- peft
- License
- other
- Created
- Jun 29, 2026
- Updated
- Jun 29, 2026