Downloads · 30 days
39
3% of all-time downloads
SufficientPrune3897/Llama-3.3-8B-Character-Creator-V2-GGUF
Llama-3.3-8B-Character-Creator-V2-GGUF is a machine learning model from SufficientPrune3897. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
GGUF quantizations of SufficientPrune3897/Llama-3.3-8B-Character-Creator-V2.
Downloads · 30 days
39
3% of all-time downloads
All-time downloads
1.2K
Public
Repo size
27.7 GB
Likes
2
Public
Click a slice to open those files.
.gguf27.7 GB · 100%
From the Hugging Face model README
GGUF quantizations of SufficientPrune3897/Llama-3.3-8B-Character-Creator-V2.
This is a model made to create characters that can be used in Sillytavern, cai, jai and other such roleplay scenarios. The resulting characters should be about ~2k tokens and follow a prebaked structure.
Versions:
| Filename | Quant | Size | Description |
|---|---|---|---|
Llama-3.3-8B-Character-Creator-V2-Q8_0.gguf | Q8_0 | 8.0GB | Maximum quality, near-lossless |
Llama-3.3-8B-Character-Creator-V2-Q5_K_M.gguf | Q5_K_M | 5.4GB | High quality, recommended |
Llama-3.3-8B-Character-Creator-V2-Q4_K_M.gguf | Q4_K_M | 4.6GB | Good quality, good balance |
Llama-3.3-8B-Character-Creator-V2-IQ4_NL.gguf | IQ4_NL | 4.4GB | Good quality, slightly smaller than Q4_K_M |
Llama-3.3-8B-Character-Creator-V2-IQ3_M.gguf | IQ3_M | 3.6GB | Smaller, some quality loss |
The next version will either reintroduce scenarios, groups or feature reasoning. Probably both. Perhaps even lorebooks, although I'm still unsure how to execute on that... After that I will probably make my own real roleplay finetune or something.
If anybody wants support of their native language just ask me and tell me what model does the best for that.
I am very much open for feedback. A single comment can easily change how I will do my next version.
This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.