Downloads · 30 days
2.3K
16% of all-time downloads
duyntnet/L3-8B-Stheno-v3.1-imatrix-GGUF
L3-8B-Stheno-v3.1-imatrix-GGUF is a text generation model from duyntnet. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
Quantizations of https://huggingface.co/Sao10K/L3-8B-Stheno-v3.1
Downloads · 30 days
2.3K
16% of all-time downloads
All-time downloads
14.4K
Public
Repo size
114 GB
Likes
1
Public
Click a slice to open those files.
.gguf114 GB · 100%
From the Hugging Face model README
Quantizations of https://huggingface.co/Sao10K/L3-8B-Stheno-v3.1
- A model made for 1-on-1 Roleplay ideally, but one that is able to handle scenarios, RPGs and storywriting fine. <br>- Uncensored during actual roleplay scenarios. # I do not care for zero-shot prompting like what some people do. It is uncensored enough in actual usecases. <br>- I quite like the prose and style for this model.
<br>- Known as L3-RP-v2.1 on Chaiverse, it did decently there [>1200 Elo] <br>- Handles character personalities well. Great for 1 on 1 Roleplay sessions. <br>- May need further token context & few-shot examples if using it as a Narrator / RPG Roleplaying session. It is able to handle them though. <br>- A model leaning towards NSFW, mention explicitly in prompts if you want to steer away. [Avoid Negative Reinforcement] <br>- Occasionally spits out leaking XML and nonsense. A regen / swipe instantly fixes that. <br>- Unique / Varied Answers when Regenerating answers. Pretty cool? <br>- Works best with some token context in the character card itself. A chef needs ingredients to cook, no?
Recommended Samplers:
Temperature - 1.12 to 1.32
Min-P - 0.075
Top-K - 40
Repetition Penalty - 1.1
Stopping Strings:
\n{{User}} # Or Equivalent, depending on Frontend
<|eot_id|>
<|end_of_text|>
\n< # If there is leakage of XML tags in response. May happen Occasionally, Regenerate Answer as Needed. Happens rarely.
Prompting Template - Llama-3-Instruct
<|begin_of_text|><|start_header_id|>system<|end_header_id|>
{system_prompt}<|eot_id|><|start_header_id|>user<|end_header_id|>
{input}<|eot_id|><|start_header_id|>assistant<|end_header_id|>
{output}<|eot_id|>
Basic Roleplay System Prompt
You are an expert actor that can fully immerse yourself into any role given. You do not break character for any reason, even if someone tries addressing you as an AI or language model.
Currently your role is {{char}}, which is described in detail below. As {{char}}, continue the exchange with {{user}}.