Downloads · 30 days
17
3% of all-time downloads
W-61/qwen3-8b-base-new-dpo-ultrafeedback-4xh200-batch-128-q_t-0.43-s_star-0.4-20260429-230725
qwen3-8b-base-new-dpo-ultrafeedback-4xh200-batch-128-q_t-0.43-s_star-0.4-20260429-230725 is a text generation model from W-61. Use it when you need the model to write or continue text. It is set up for transformers.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
17
3% of all-time downloads
All-time downloads
626
Public
Parameters
8.2B
32.8 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors32.8 GB · 100%
From the Hugging Face model README
This model is a fine-tuned version of jackf857/qwen3-8b-base-sft-ultrachat-4xh200-batch-128 on the HuggingFaceH4/ultrafeedback_binarized dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Kl/chosen Kl Mean | Kl/mean | Kl/rejected Kl Mean | Kl/std | Fcm Dpo/beta | Logits/chosen | Logits/rejected | Logps/chosen | Logps/ref Chosen | Logps/ref Rejected | Logps/rejected | Validation Loss | Margin Dpo/margin Mean | Margin Dpo/margin Std |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 4.8732 | 0.4188 | 200 | -7.6098 | -20.6141 | -33.6184 | 36.4948 | 0.0114 | 1.5705 | 1.6149 | -288.0265 | -280.4167 | -264.6455 | -298.2639 | 0.5900 | 26.0086 | 42.7299 |
| 4.6016 | 0.8377 | 400 | 0.5897 | 0.0056 | 51.0513 | 81.3439 | -321.9651 | -357.2452 | -280.4167 | -264.6455 | -41.5484 | -92.5997 | -67.0741 | 70.1467 | 1.5636 | 1.6451 |