Downloads · 30 days
556
11% of all-time downloads
duyntnet/UTENA-7B-NSFW-V2-imatrix-GGUF
UTENA-7B-NSFW-V2-imatrix-GGUF is a text generation model from duyntnet. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
Quantizations of https://huggingface.co/AI-B/UTENA-7B-NSFW-V2
Downloads · 30 days
556
11% of all-time downloads
All-time downloads
5K
Public
Repo size
99.9 GB
Likes
0
Public
Click a slice to open those files.
.gguf99.9 GB · 100%
From the Hugging Face model README
Quantizations of https://huggingface.co/AI-B/UTENA-7B-NSFW-V2
This is a merge of pre-trained language models created using mergekit.
This model was merged using the SLERP merge method.
The following models were included in the merge:
The following YAML configuration was used to produce this model:
slices:
- sources:
- model: AI-B/UTENA-7B-NSFW
layer_range: [0, 32]
- model: AI-B/UTENA-7B-BAGEL
layer_range: [0, 32]
merge_method: slerp
base_model: AI-B/UTENA-7B-NSFW
parameters:
t:
- filter: self_attn
value: [0, 0.5, 0.3, 0.7, 1]
- filter: mlp
value: [1, 0.5, 0.7, 0.3, 0]
- value: 0.5
dtype: bfloat16