Skip to content

LoneStriker

Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-7.0bpw-h6-exl2

LoneStriker/Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-7.0bpw-h6-exl2

Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-7.0bpw-h6-exl2 is a text generation model from LoneStriker. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.

Experimental model, using a limarp qlora trained at 10k ctx length (greater than size of the longest limarp sample when tokenized via mistral's tokenizer) on mistralai/Mixtral-8x7B-v0.1 using Charles Goddard's ZLoss a…

Downloads · 30 days

7

3% of all-time downloads

All-time downloads

239

Public

Repo size

41 GB

Likes

1

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors41 GB · 100%

At a glance

Task
Text Generation
Library
transformers
License
apache-2.0
Model type
mixtral
Access
Public
Created
Jan 7, 2024
Updated
Jan 7, 2024
SHA
5c14e2a4

Try a prompt

Task
Text Generation
Library
transformers
Type
mixtral
License
apache-2.0
Languages
en
Created
Jan 7, 2024
Updated
Jan 7, 2024