Downloads · 30 days
28
26% of all-time downloads
Codellama-2-7b-Miniguanaco-Mistral
Nexesenex/Codellama-2-7b-Miniguanaco-Mistral
Codellama-2-7b-Miniguanaco-Mistral is a text generation model from Nexesenex. Use it when you need the model to write or continue text. It is set up for transformers.
All-time downloads
108
Public
Repo size
27 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.bin13.5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- llama
- Access
- Public
- Created
- Oct 2, 2023
- Updated
- Oct 2, 2023
- SHA
- 09ac5402
Try a prompt
Model card
From the Hugging Face model README
license: llama2
CodeLlama 2 7b
With Guanaco Lora (Tim Dettmers), merged by Varunk29.
Then
With Mistral AI 7b 0.1 delta bits compared to Llama2 (extracted by Undi95), merged by me.
Base model (CodeLlama) training context : 16k (max context up to 96k with the base ROPE)
Mistral injection training context : 8k (Sliding Windows Attention is likely inoperant on such a merge/injection)
For test and amusement only.
Prompt : Alpaca works.
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- Created
- Oct 2, 2023
- Updated
- Oct 2, 2023