Downloads · 30 days
6
8% of all-time downloads
RefalMachine/ruadapt_qwen2.5_3B_darulm_cl100k_extended_u60k_full_lr3e4_bs256
ruadapt_qwen2.5_3B_darulm_cl100k_extended_u60k_full_lr3e4_bs256 is a machine learning model from RefalMachine. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
6
8% of all-time downloads
All-time downloads
78
Public
Parameters
3.1B
13 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors12.4 GB · 87%
From the Hugging Face model README
This model is a fine-tuned version of RefalMachine/ruadapt_qwen2.5_3B_darulm_cl100k_extended_u60k_mean_init on an unknown dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | Accuracy |
|---|---|---|---|---|
| No log | 0.0 | 1 | 6.1187 | 0.3010 |
| 2.7048 | 0.18 | 2000 | 2.5875 | 0.4848 |
| 2.6779 | 0.36 | 4000 | 2.5606 | 0.4874 |
| 2.6647 | 0.54 | 6000 | 2.5522 | 0.4886 |
| 2.6619 | 0.72 | 8000 | 2.5495 | 0.4888 |
| 2.6655 | 0.91 | 10000 | 2.5490 | 0.4889 |