Downloads · 30 days
15
23% of all-time downloads
Airoboros-c34b-2.2.1-Mistral
Nexesenex/Airoboros-c34b-2.2.1-Mistral
Airoboros-c34b-2.2.1-Mistral is a text generation model from Nexesenex. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama2.
All-time downloads
64
Public
Repo size
135 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.bin67.5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- llama2
- Model type
- llama
- Access
- Public
- Created
- Oct 2, 2023
- Updated
- Oct 2, 2023
- SHA
- 175c5581
Try a prompt
Model card
From the Hugging Face model README
Airoboros c34 2.2.1 Mistral
CodeLlama 34b With Airoboros 2.2.1 dataset by Jon Durbin
Then
With Mistral AI 7b 0.1 delta bits compared to Llama2 (extracted by Undi95), merged by myself.
Base model (CodeLlama) training context : 16k (max context up to 96k with the base ROPE)
Mistral injection training context : 8k (Sliding Windows Attention is likely inoperant on such a merge/injection)
For test and amusement only.
Prompt : Airoboros
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- llama2
- Created
- Oct 2, 2023
- Updated
- Oct 2, 2023