Downloads · 30 days
10
19% of all-time downloads
Mascobot/OpenOrca_Airoboros
OpenOrca_Airoboros is a text generation model from Mascobot. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This Mistral 7B model is trained on a mix of datasets filtered for higher quality and output length. The mix of datasets was composed to increase reasoning and creativity.
Downloads · 30 days
10
19% of all-time downloads
All-time downloads
53
Public
Repo size
30 GB
Likes
0
Public
Click a slice to open those files.
.bin15 GB · 100%
From the Hugging Face model README
This Mistral 7B model is trained on a mix of datasets filtered for higher quality and output length. The mix of datasets was composed to increase reasoning and creativity.
Datasets:
The mix of datasets is composed of a filtered version of the OpenOrca and Airoboros 2.2.1 datasets.
Training:
Full model training took 17 hours with 4 epochs on 8x A100s.
Prompt format: This model uses the ChatML prompt format (OpenAI's format).
<|im_start|>system You are a helpful AI assistant.<|im_end|> <|im_start|>user {prompt}<|im_end|> <|im_start|>assistant