Downloads · 30 days
234
20% of all-time downloads
sanchit-gandhi/distil-zephyr-1.5b-ssft-ultrachat
distil-zephyr-1.5b-ssft-ultrachat is a text generation model from sanchit-gandhi. Use it when you need the model to write or continue text. It is set up for transformers.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
234
20% of all-time downloads
All-time downloads
1.2K
Public
Parameters
1.6B
15.7 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors3.1 GB · 99%
From the Hugging Face model README
This model is a fine-tuned version of sanchit-gandhi/Mistral-7B-v0.1-6-layer on the stingning/ultrachat dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss |
|---|---|---|---|
| 1.135 | 1.2361 | 5000 | 1.0484 |
| 0.9717 | 2.4722 | 10000 | 1.0058 |
| 0.8643 | 3.7083 | 15000 | 0.9966 |
| 0.8191 | 4.9444 | 20000 | 1.0042 |