Downloads · 30 days
79
6% of all-time downloads
KeinNiemand/Kuwutu-7B-CYOA-IK-GGUF-v2
Kuwutu-7B-CYOA-IK-GGUF-v2 is a text generation model from KeinNiemand. Use it when you need the model to write or continue text. The card lists the license as cc-by-nc-4.0.
IK-specific GGUF quantizations of Kuwutu-7B-CYOA-v2, a model for CYOA-style interactive fiction.
Downloads · 30 days
79
6% of all-time downloads
All-time downloads
1.3K
Public
Repo size
35.8 GB
Likes
0
Public
Click a slice to open those files.
.gguf35.8 GB · 100%
From the Hugging Face model README
IK-specific GGUF quantizations of Kuwutu-7B-CYOA-v2, a model for CYOA-style interactive fiction.
These files require ikawrakow/ik_llama.cpp. For mainline-compatible files, use Kuwutu-7B-CYOA-GGUF-v2.
See the full model card for model details.
Kuwutu-7B-CYOA-v2-IQ6_K.ggufKuwutu-7B-CYOA-v2-IQ5_K.ggufKuwutu-7B-CYOA-v2-IQ5_KS.ggufKuwutu-7B-CYOA-v2-IQ4_K.ggufKuwutu-7B-CYOA-v2-IQ4_KS.ggufKuwutu-7B-CYOA-v2-IQ4_KSS.ggufKuwutu-7B-CYOA-v2-IQ3_K.ggufKuwutu-7B-CYOA-v2-IQ2_KL.ggufThe quantizations use an importance matrix generated from representative project calibration text.