Downloads · 30 days
8
12% of all-time downloads
mpasila/mistral-7b-v0.1-layla-v4-exl2-4bpw
mistral-7b-v0.1-layla-v4-exl2-4bpw is a text generation model from mpasila. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This is an ExLlamaV2 quantized model in 4bpw of l3utterfly/mistral-7b-v0.1-layla-v4 using the default calibration dataset.
Downloads · 30 days
8
12% of all-time downloads
All-time downloads
65
Public
Repo size
3.9 GB
Likes
0
Public
Click a slice to open those files.
.safetensors3.9 GB · 100%
From the Hugging Face model README
This is an ExLlamaV2 quantized model in 4bpw of l3utterfly/mistral-7b-v0.1-layla-v4 using the default calibration dataset.
Mistral 7B fine-tuned by the OpenHermes 2.5 dataset optimised for multi-turn conversation and character impersonation.
The dataset has been pre-processed by doing the following:
Base model used by Layla - the offline personal assistant: https://www.layla-network.ai
Help & support: https://discord.gg/x546YJ6nYC
Prompt:
USER:
ASSISTANT: