Downloads · 30 days
8
9% of all-time downloads
grimjim/kuno-kunoichi-v1-DPO-v2-SLERP-7B-8.0bpw_h8_exl2
kuno-kunoichi-v1-DPO-v2-SLERP-7B-8.0bpw_h8_exl2 is a text generation model from grimjim. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as cc-by-nc-4.0.
This is an 8.0bpw exl2 quant of a merge of pre-trained language models created using mergekit. Full weights are here. Q80 GGUF quant is here.
Downloads · 30 days
8
9% of all-time downloads
All-time downloads
91
Public
Repo size
7.4 GB
Likes
1
Public
Click a slice to open those files.
.safetensors7.4 GB · 100%
From the Hugging Face model README
This is an 8.0bpw exl2 quant of a merge of pre-trained language models created using mergekit. Full weights are here. Q8_0 GGUF quant is here.
Light testing was performed with ChatML format prompting using temperature 1 to 1.1 and minP 0.01 to 0.03. The model natively supports Alpaca format prompts.
This model was merged using the SLERP merge method.
The following models were included in the merge:
The following YAML configuration was used to produce this model:
slices:
- sources:
- model: SanjiWatsuki/Kunoichi-7B
layer_range: [0,32]
- model: SanjiWatsuki/Kunoichi-DPO-v2-7B
layer_range: [0,32]
merge_method: slerp
base_model: SanjiWatsuki/Kunoichi-7B
parameters:
t:
- value: 0.5
dtype: float16