Downloads · 30 days
96
1% of all-time downloads
mistral-sft-v3
andysalerno/mistral-sft-v3
mistral-sft-v3 is a text generation model from andysalerno. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This is mistralai/Mistral-7B-v0.1, but with the special tokens added for ChatML, and then lightly finetuned with sft using a ChatML formatted dataset: andysalerno/ansalern-nectar-inputoutput
All-time downloads
17.8K
Public
Parameters
7.2B
14.5 GB on disk
Likes
3
Public
Repo makeup
Click a slice to open those files.
.safetensors14.5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- mistral
- Access
- Public
- Created
- Jan 30, 2024
- Updated
- Mar 7, 2024
- SHA
- d0eefc4e
Try a prompt
Base models
Model card
From the Hugging Face model README
This is mistralai/Mistral-7B-v0.1, but with the special tokens added for ChatML, and then lightly finetuned with sft using a ChatML formatted dataset: andysalerno/ansalern-nectar-inputoutput
The training was very light, so while this model correctly follows ChatML formatting, it is not intended to be a chat model.
Rather, it is intended to be a base for further fine-tuning models that will use ChatML.
Open LLM Leaderboard Evaluation Results
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 60.93 |
| AI2 Reasoning Challenge (25-Shot) | 61.35 |
| HellaSwag (10-Shot) | 82.23 |
| MMLU (5-Shot) | 63.40 |
| TruthfulQA (0-shot) | 48.49 |
| Winogrande (5-shot) | 77.66 |
| GSM8k (5-shot) | 32.45 |
- Task
- Text Generation
- Library
- transformers
- Type
- mistral
- License
- apache-2.0
- Featherless Ai
- live
- Created
- Jan 30, 2024
- Updated
- Mar 7, 2024