Downloads · 30 days
6
7% of all-time downloads
kaleinaNyan/kolibri-mistral-0427-upd
kolibri-mistral-0427-upd is a text generation model from kaleinaNyan. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This is an instruction following model (based on Mistral v0.1 Base) optimized for Russian language. It was trained using kolibrify on a multitude of instruction datasets.
Downloads · 30 days
6
7% of all-time downloads
All-time downloads
81
Public
Parameters
7.2B
14.5 GB on disk
Likes
1
Public
Click a slice to open those files.
.safetensors14.5 GB · 100%
From the Hugging Face model README
This is an instruction following model (based on Mistral v0.1 Base) optimized for Russian language. It was trained using kolibrify on a multitude of instruction datasets.
The model uses ChatML template. It was trained to be sensitive to the system prompt, experiment with it.
Currently in pre-alpha, later releases will include more details regarding training procedure and data mix.
[!NOTE] This model is an improved version of older kolibri-mistral-0427.
The model was tested using the following benchmarks:
| Eval name | Strict Value | Loose Value |
|---|---|---|
| Avg. | 53.81 | 56.57 |
| ifeval-prompt-level | 52.68 | 56.19 |
| ifeval-instruction-level | 62.82 | 66.18 |
| ru-ifeval-prompt-level | 44.36 | 46.39 |
| ru-ifeval-instruction-level | 55.39 | 57.55 |