Downloads · 30 days
373
6% of all-time downloads
QuantFactory/Poppy_Porpoise-1.4-L3-8B-GGUF
Poppy_Porpoise-1.4-L3-8B-GGUF is a text generation model from QuantFactory. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
This is quantized version of ChaoticNeutrals/PoppyPorpoise-1.4-L3-8B created using llama.cpp
Downloads · 30 days
373
6% of all-time downloads
All-time downloads
5.9K
Public
Repo size
72.7 GB
Likes
1
Public
Click a slice to open those files.
.gguf72.7 GB · 100%
From the Hugging Face model README
This is quantized version of ChaoticNeutrals/Poppy_Porpoise-1.4-L3-8B created using llama.cpp
"Poppy Porpoise" is a cutting-edge AI roleplay assistant based on the Llama 3 8B model, specializing in crafting unforgettable narrative experiences. With its advanced language capabilities, Poppy expertly immerses users in an interactive and engaging adventure, tailoring each adventure to their individual preferences.
Note: This variant is an attempt to get something closer to 0.72 while maintaining the improvements of 1.30.
The following YAML configuration was used to produce this model:
slices:
- sources:
- model: Nitral-AI/Pp-72xra1
layer_range: [0, 32]
- model: Nitral-AI/Poppy-1.35-Phase1
layer_range: [0, 32]
merge_method: slerp
base_model: Nitral-AI/Pp-72xra1
parameters:
t:
- filter: self_attn
value: [0, 0.5, 0.3, 0.7, 1]
- filter: mlp
value: [1, 0.5, 0.7, 0.3, 0]
- value: 0.5
dtype: bfloat16