Downloads · 30 days
3
12% of all-time downloads
zhendrysiak/Bielik-4.5B-v3.0-Instruct-random-4.5-finetune-r-8-alpha-16-02022025_hq
Bielik-4.5B-v3.0-Instruct-random-4.5-finetune-r-8-alpha-16-02022025_hq is a text generation model from zhendrysiak. Use it when you need the model to write or continue text. It is set up for peft. The card lists the license as apache-2.0.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
3
12% of all-time downloads
All-time downloads
25
Public
Repo size
232 MB
Likes
0
Public
Click a slice to open those files.
.safetensors232 MB · 98%
From the Hugging Face model README
This model is a fine-tuned version of speakleash/Bielik-4.5B-v3.0-Instruct on the None dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss |
|---|---|---|---|
| No log | 0.0182 | 100 | 13.0687 |
| No log | 0.0364 | 200 | 198.8019 |
| No log | 0.0545 | 300 | 13.7844 |
| No log | 0.0727 | 400 | 13.6102 |
| 31.7392 | 0.0909 | 500 | 13.3213 |
| 31.7392 | 0.1091 | 600 | 13.0391 |
| 31.7392 | 0.1273 | 700 | 12.7387 |
| 31.7392 | 0.1455 | 800 | 12.4533 |
| 31.7392 | 0.1636 | 900 | 12.1263 |
| 12.608 | 0.1818 | 1000 | 11.8422 |
| 12.608 | 0.2 | 1100 | 11.5073 |
| 12.608 | 0.2182 | 1200 | 11.2609 |
| 12.608 | 0.2364 | 1300 | 11.1205 |
| 12.608 | 0.2545 | 1400 | 13.9034 |
| 18.5234 | 0.2727 | 1500 | 13.5863 |
| 18.5234 | 0.2909 | 1600 | 13.5501 |
| 18.5234 | 0.3091 | 1700 | 13.5133 |
| 18.5234 | 0.3273 | 1800 | 13.5011 |
| 18.5234 | 0.3455 | 1900 | 13.4605 |
| 13.5746 | 0.3636 | 2000 | 13.4289 |
| 13.5746 | 0.3818 | 2100 | 13.3880 |
| 13.5746 | 0.4 | 2200 | 13.3253 |
| 13.5746 | 0.4182 | 2300 | 13.2685 |
| 13.5746 | 0.4364 | 2400 | 13.2326 |
| 13.3403 | 0.4545 | 2500 | 13.1774 |
| 13.3403 | 0.4727 | 2600 | 13.1508 |
| 13.3403 | 0.4909 | 2700 | 13.0815 |
| 13.3403 | 0.5091 | 2800 | 13.0063 |
| 13.3403 | 0.5273 | 2900 | 12.9225 |
| 13.0741 | 0.5455 | 3000 | 12.8694 |
| 13.0741 | 0.5636 | 3100 | 12.7907 |
| 13.0741 | 0.5818 | 3200 | 12.7317 |
| 13.0741 | 0.6 | 3300 | 12.6500 |
| 13.0741 | 0.6182 | 3400 | 12.6017 |
| 12.7737 | 0.6364 | 3500 | 12.5411 |
| 12.7737 | 0.6545 | 3600 | 12.4787 |
| 12.7737 | 0.6727 | 3700 | 12.4226 |
| 12.7737 | 0.6909 | 3800 | 12.3603 |
| 12.7737 | 0.7091 | 3900 | 12.2983 |
| 12.4938 | 0.7273 | 4000 | 12.2481 |
| 12.4938 | 0.7455 | 4100 | 12.2054 |
| 12.4938 | 0.7636 | 4200 | 12.1522 |
| 12.4938 | 0.7818 | 4300 | 12.1059 |
| 12.4938 | 0.8 | 4400 | 12.0757 |
| 12.2329 | 0.8182 | 4500 | 12.0363 |
| 12.2329 | 0.8364 | 4600 | 12.0047 |
| 12.2329 | 0.8545 | 4700 | 11.9664 |
| 12.2329 | 0.8727 | 4800 | 11.9496 |
| 12.2329 | 0.8909 | 4900 | 11.9166 |
| 12.087 | 0.9091 | 5000 | 11.9032 |
| 12.087 | 0.9273 | 5100 | 11.8916 |
| 12.087 | 0.9455 | 5200 | 11.8695 |
| 12.087 | 0.9636 | 5300 | 11.8556 |
| 12.087 | 0.9818 | 5400 | 11.8477 |
| 11.9798 | 1.0 | 5500 | 11.8489 |