Downloads · 30 days
577
2% of all-time downloads
Lewdiculous/Poppy_Porpoise-v0.7-L3-8B-GGUF-IQ-Imatrix
Poppy_Porpoise-v0.7-L3-8B-GGUF-IQ-Imatrix is a machine learning model from Lewdiculous. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
[!CAUTION] New and improved version here: <br Prefer the new version 0.72 here!
Downloads · 30 days
577
2% of all-time downloads
All-time downloads
29K
Public
Repo size
137 GB
Likes
29
Public
Click a slice to open those files.
.gguf68.3 GB · 100%
From the Hugging Face model README
[!CAUTION] New and improved version here: <br> Prefer the new version 0.72 here!
[!TIP] My upload speeds have been cooked and unstable lately. <br> Realistically I'd need to move to get a better provider. <br> If you want and you are able to... <br> You can support my various endeavors here (Ko-fi). <br> I apologize for disrupting your experience.
"It keeps getting better!"
"One of the top recent performers in the Chaiverse Leaderboard!"
GGUF-IQ-Imatrix quants for ChaoticNeutrals/Poppy_Porpoise-v0.7-L3-8B.
[!IMPORTANT]
Updated! These quants have been redone with the fixes from llama.cpp/pull/6920 in mind. <br> Use KoboldCpp version 1.64 or higher.
[!WARNING] Compatible SillyTavern presets here (recommended/simple)) or here (Virt's). <br> Use the latest version of KoboldCpp. Use the provided presets. <br> This is all still highly experimental, let the authors know how it performs for you, feedback is more important than ever now.
[!NOTE] For 8GB VRAM GPUs, I recommend the Q4_K_M-imat quant for up to 12288 context sizes.
Original model information:

If you want to use vision functionality:
