Downloads · 30 days
6
4% of all-time downloads
knifeayumu/Lite-Cydonia-22B-v1.1-75-25
Lite-Cydonia-22B-v1.1-75-25 is a text generation model from knifeayumu. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
"A balancing act between smart do-gooders and creative evil-doers."
Downloads · 30 days
6
4% of all-time downloads
All-time downloads
144
Public
Parameters
22.2B
44.5 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors44.5 GB · 100%
From the Hugging Face model README
"A balancing act between smart do-gooders and creative evil-doers."
This is a merge of pre-trained language models created using mergekit.
GGUF quants : knifeayumu/Lite-Cydonia-22B-v1.1-75-25-GGUF
I thought both BeaverAI/Cydonia-22B-v1f-GGUF and BeaverAI/Cydonia-22B-v1e-GGUF versions were a bit too evil. The sense of morality was too screwed up, and it was quite deterministic (swipes didn't offer much variety) compared to the base model. Then an idea popped into my mind — why not merge it back with the base model? That way, we could give it a sense of "good" again, at least a little. Maybe this would also fix some of the deterministic generations.
Quick testing shows... it works? Zero-shot evil Q&A no longer works, but with a bit of persuasion, it did answer. But I think the model is a bit too dumb for my liking.
Credits to TheDrummer and BeaverAI who makes such finetunes. "Lightly decensored" is a heavy understatement in this case.
This model was merged using the task arithmetic merge method using TheDrummer/Cydonia-22B-v1.1 as a base.
The following models were included in the merge:
The following YAML configuration was used to produce this model:
models:
- model: TheDrummer/Cydonia-22B-v1.1
parameters:
weight: 0.75
- model: mistralai/Mistral-Small-Instruct-2409
parameters:
weight: 0.25
merge_method: task_arithmetic
base_model: TheDrummer/Cydonia-22B-v1.1
dtype: float16