Downloads · 30 days
2
12% of all-time downloads
rocker417/llama3.2-3B-added-tokens-wiki-cursor-backspace-left-right-cosine-loss-8-lora
llama3.2-3B-added-tokens-wiki-cursor-backspace-left-right-cosine-loss-8-lora is a machine learning model from rocker417. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
2
12% of all-time downloads
All-time downloads
17
Public
Parameters
3.2B
14.2 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors12.7 GB · 89%
From the Hugging Face model README
This model is a fine-tuned version of rocker417/llama3.2-3B-added-tokens on an unknown dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss |
|---|---|---|---|
| 3.1845 | 0.0988 | 1000 | 2.5983 |
| 2.5334 | 0.1976 | 2000 | 2.4032 |
| 2.4184 | 0.2965 | 3000 | 2.3327 |
| 2.336 | 0.3953 | 4000 | 2.2915 |
| 2.2717 | 0.4941 | 5000 | 2.2409 |
| 2.2903 | 0.5929 | 6000 | 2.2048 |
| 2.248 | 0.6918 | 7000 | 2.1751 |
| 2.2132 | 0.7906 | 8000 | 2.1653 |
| 2.1643 | 0.8894 | 9000 | 2.1480 |
| 2.1624 | 0.9882 | 10000 | 2.1410 |