Downloads · 30 days
6
10% of all-time downloads
martimfasantos/cpo-xcomet-xl_xxl-inc7b-10p-shuff-5e-7-full-tiny2
cpo-xcomet-xl_xxl-inc7b-10p-shuff-5e-7-full-tiny2 is a text generation model from martimfasantos. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
6
10% of all-time downloads
All-time downloads
63
Public
Parameters
1.1B
2.2 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors2.2 GB · 100%
From the Hugging Face model README
This model is a fine-tuned version of TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T on the Unbabel/TowerAligned-v0.1 dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | Nll Loss | Logps/best | Rewards/chosen | Rewards/rejected | Rewards/accuracies | Rewards/margins | Logps/rejected | Logps/chosen | Logits/rejected | Logits/chosen |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 3.1908 | 0.5317 | 500 | 2.7136 | 1.0203 | -99.1796 | -9.9180 | -9.3876 | 0.4600 | -0.5304 | -93.8759 | -99.1796 | -1.8188 | -1.9550 |
| 2.7347 | 1.0635 | 1000 | 2.6365 | 0.9846 | -95.9023 | -9.5902 | -9.1174 | 0.4720 | -0.4728 | -91.1739 | -95.9023 | -1.8087 | -1.9438 |
| 2.5644 | 1.5952 | 1500 | 2.6035 | 0.9703 | -94.5918 | -9.4592 | -9.0135 | 0.4680 | -0.4456 | -90.1355 | -94.5918 | -1.8043 | -1.9388 |
| 2.6495 | 2.1270 | 2000 | 2.5883 | 0.9646 | -94.0702 | -9.4070 | -8.9746 | 0.4720 | -0.4324 | -89.7462 | -94.0702 | -1.8018 | -1.9361 |
| 2.4747 | 2.6587 | 2500 | 2.5858 | 0.9632 | -93.9459 | -9.3946 | -8.9636 | 0.4740 | -0.4310 | -89.6356 | -93.9459 | -1.8013 | -1.9355 |