Downloads · 30 days
25
8% of all-time downloads
sanchit-gandhi/distil-zephyr-1.5b-ssft
distil-zephyr-1.5b-ssft is a text generation model from sanchit-gandhi. Use it when you need the model to write or continue text. It is set up for transformers.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
25
8% of all-time downloads
All-time downloads
304
Public
Parameters
1.6B
37.7 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors3.1 GB · 100%
From the Hugging Face model README
This model is a fine-tuned version of sanchit-gandhi/Mistral-7B-v0.1-6-layer on the HuggingFaceH4/ultrachat_200k dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss |
|---|---|---|---|
| 4.8342 | 1.0 | 273 | 4.7379 |
| 3.3301 | 2.0 | 546 | 3.2846 |
| 2.4158 | 3.0 | 819 | 2.4134 |
| 2.1322 | 4.0 | 1092 | 2.1637 |
| 2.0369 | 5.0 | 1365 | 2.1183 |