Downloads · 30 days
10
2% of all-time downloads
jackf857/qwen3-8b-base-new-dpo-ultrafeedback-4xh200-batch-128-q_t-0.45-s_star-0.4
qwen3-8b-base-new-dpo-ultrafeedback-4xh200-batch-128-q_t-0.45-s_star-0.4 is a text generation model from jackf857. Use it when you need the model to write or continue text. It is set up for transformers.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
10
2% of all-time downloads
All-time downloads
472
Public
Parameters
8.2B
32.8 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors32.8 GB · 100%
From the Hugging Face model README
This model is a fine-tuned version of jackf857/qwen3-8b-base-sft-ultrachat-4xh200-batch-128 on the HuggingFaceH4/ultrafeedback_binarized dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | Fcm Dpo/beta | Margin Dpo/margin Mean | Margin Dpo/margin Std | Logps/chosen | Logps/rejected | Logps/ref Chosen | Logps/ref Rejected | Kl/chosen Kl Mean | Kl/rejected Kl Mean | Kl/mean | Kl/std | Logits/chosen | Logits/rejected |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 4.8731 | 0.4188 | 200 | 0.5751 | 0.0154 | 23.0896 | 36.1352 | -284.8843 | -292.2027 | -280.4167 | -264.6455 | -4.4676 | -27.5572 | -16.0124 | 31.6575 | 1.6198 | 1.6611 |
| 4.5255 | 0.8377 | 400 | 0.5766 | 0.0072 | 47.1411 | 72.3220 | -314.3019 | -345.6718 | -280.4167 | -264.6455 | -33.8852 | -81.0263 | -57.4557 | 62.9633 | 1.4237 | 1.4794 |