Downloads · 30 days
43
8% of all-time downloads
kykim0/pythia-410m-tulu-v2-mix
pythia-410m-tulu-v2-mix is a text generation model from kykim0. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
43
8% of all-time downloads
All-time downloads
566
Public
Parameters
405M
2.4 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors811 MB · 100%
From the Hugging Face model README
This model is a fine-tuned version of EleutherAI/pythia-410m on the allenai/tulu-v2-sft-mixture dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss |
|---|---|---|---|
| 1.6351 | 0.9999 | 2548 | 1.4234 |
| 1.3173 | 1.9998 | 5096 | 1.2321 |
| 1.1209 | 2.9997 | 7644 | 1.2142 |