Downloads · 30 days
13
2% of all-time downloads
W-61/qwen3-8b-base-margin-dpo-ultrafeedback-4xh200-batch-128-20260423-040315
qwen3-8b-base-margin-dpo-ultrafeedback-4xh200-batch-128-20260423-040315 is a text generation model from W-61. Use it when you need the model to write or continue text. It is set up for transformers.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
13
2% of all-time downloads
All-time downloads
624
Public
Parameters
8.2B
32.8 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors32.8 GB · 100%
From the Hugging Face model README
This model is a fine-tuned version of W-61/qwen3-8b-base-sft-ultrachat-4xh200-batch-128 on the HuggingFaceH4/ultrafeedback_binarized dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | Margin Dpo/margin Mean | Margin Dpo/margin Std | Logps/chosen | Logps/rejected | Logps/ref Chosen | Logps/ref Rejected | Logits/chosen | Logits/rejected |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 4.9383 | 0.4188 | 200 | 0.5970 | 28.2584 | 39.0244 | -287.0227 | -295.6718 | -281.4589 | -261.8495 | 1.4300 | 1.4697 |
| 4.2739 | 0.8377 | 400 | 0.5602 | 48.7131 | 68.1546 | -316.0414 | -345.1451 | -281.4589 | -261.8495 | 1.1933 | 1.2367 |