Downloads · 30 days
0
0% of all-time downloads
Solstice-Mixtral-v1-exl2-rpcal
rAIfle/Solstice-Mixtral-v1-exl2-rpcal
Solstice-Mixtral-v1-exl2-rpcal is a machine learning model from rAIfle. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as cc-by-nc-4.0.
Quantized using 200 samples of 8192 tokens from an RP-oriented PIPPA dataset.
All-time downloads
3
Public
Repo size
70.5 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.json1.8 MB · 100%
At a glance
- License
- cc-by-nc-4.0
- Access
- Public
- Created
- Feb 19, 2024
- Updated
- Feb 19, 2024
- SHA
- b7ec9a8d
Base models
Datasets
Model card
From the Hugging Face model README
Quantized using 200 samples of 8192 tokens from an RP-oriented PIPPA dataset.
Branches:
main--measurement.json2.25b6h-- 2.25bpw, 6bit lm_head3.7b6h-- 3.7bpw, 6bit lm_head6b6h-- 6bpw, 6bit lm_head
Requires ExllamaV2 version 0.0.12 and up.
Original model link: Sao10K/Solstice-Mixtral-v1
Original model README below.
GGUF: https://huggingface.co/Sao10K/Solstice-Mixtral-v1-GGUF
Solstice-11B-v1 but on Mixtral. More info there.
Experimental. May or may not be good, Mixtral training is... difficult to work with.
Trained with Vicuna / ShareGPT Format, but Alpaca Instruct should work fine too.
As per usual, handles itself fine in NSFW Scenarios, after all, it is trained in lewd outputs. A bit of a weird behaviour where it is reluctant in zero-shot settings, but in actual roleplays / usage? It's fine.
Pretty nice. Using Vicuna gave slightly better outputs than Alpaca, but it may be a minor difference?
I like that it stays in character.
I like using Universal-Light preset in SillyTavern.
I really appreciate your feedback / supportive comments. They keep me going.
Support me here :)
- License
- cc-by-nc-4.0
- Languages
- en
- Created
- Feb 19, 2024
- Updated
- Feb 19, 2024