Downloads · 30 days
176
8% of all-time downloads
NeuR0mancR/Pale-Sonneteer-24B-GGUF
Pale-Sonneteer-24B-GGUF is a text generation model from NeuR0mancR. Use it when you need the model to write or continue text. It is set up for gguf. The card lists the license as apache-2.0.
"Je meurs aussi de ta mélancolie... Un soir de demi-brume" – d'après Nelligan et Apollinaire
Downloads · 30 days
176
8% of all-time downloads
All-time downloads
2.2K
Public
Repo size
160 GB
Likes
2
Public
Click a slice to open those files.
.gguf160 GB · 100%
From the Hugging Face model README

"Je meurs aussi de ta mélancolie... Un soir de demi-brume" – d'après Nelligan et Apollinaire
The GGUF version of my first model. An experiment with karcher. The Pale Sonneteer is a writing/RP model.
These are static and weighted/imatrix quants of https://huggingface.co/NeuR0mancR/Pale-Sonneteer
The IQ-quants and imatrix quants were calibrated with a custom importance matrix to preserve metaphorical depth and dark-academic vocabulary, to stay in line with the model's theme. Feel free to requantize with your own if you desire to preserve a different set of weights. The imatrix.dat used is included in this repo. IQ quants are recommended over similar sized non-IQ quantization.
Feel free to share your feedbacks and let me know if you encounter weird behaviour during inference.
Note: The IQ and K_M quants use the custom Gothic imatrix. Static quants (Q6_K, Q8_0) are provided for purists.