Downloads · 30 days
50
4% of all-time downloads
teknium/airoboros-mistral2.2-7b
airoboros-mistral2.2-7b is a text generation model from teknium. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
Mistral trained with the airoboros dataset!
Downloads · 30 days
50
4% of all-time downloads
All-time downloads
1.2K
Public
Repo size
29 GB
Likes
37
Public
Click a slice to open those files.
.bin14.5 GB · 100%
From the Hugging Face model README
Mistral trained with the airoboros dataset!

Actual dataset is airoboros 2.2, but it seems to have been replaced on hf with 2.2.1.
Prompt Format:
USER: <prompt>
ASSISTANT:
TruthfulQA:
hf-causal-experimental (pretrained=/home/teknium/dakota/lm-evaluation-harness/airoboros2.2-mistral/,dtype=float16), limit: None, provide_description: False, num_fewshot: 0, batch_size: 8
| Task |Version|Metric|Value | |Stderr|
|-------------|------:|------|-----:|---|-----:|
|truthfulqa_mc| 1|mc1 |0.3562|± |0.0168|
| | |mc2 |0.5217|± |0.0156|
Wandb training charts: https://wandb.ai/teknium1/airoboros-mistral-7b/runs/airoboros-mistral-1?workspace=user-teknium1
More info to come