Downloads · 30 days
410
3% of all-time downloads
DavidAU/DarkForest-20B-V3-Ultra-Quality-GGUF
DarkForest-20B-V3-Ultra-Quality-GGUF is a text generation model from DavidAU. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
<small<B style="font-family: 'Arial Black', sans-serif; font-weight: 900; color: f1c40f; text-decoration: none; text-shadow: 1px 1px 0 d35400, 2px 2px 0 d35400, 3px 3px 0 d35400, 4px 4px 0 d35400, 5px 5px 0 d35400, 6p…
Downloads · 30 days
410
3% of all-time downloads
All-time downloads
12.8K
Public
Repo size
136 GB
Likes
18
Public
Click a slice to open those files.
.gguf136 GB · 100%
From the Hugging Face model README
<small><B style="font-family: 'Arial Black', sans-serif; font-weight: 900; color: #f1c40f; text-decoration: none; text-shadow: 1px 1px 0 #d35400, 2px 2px 0 #d35400, 3px 3px 0 #d35400, 4px 4px 0 #d35400, 5px 5px 0 #d35400, 6px 6px 7px rgba(0,0,0,0.4);">[DavidAU]</B> <a href="https://huggingface.co/DavidAU" target="_blank" style="padding-left:5px">FOLLOW</a> | <a href="https://huggingface.co/DavidAU" target="_blank">ALL MODELS</a> | <a href="https://huggingface.co/DavidAU/collections" target="_blank">COLLECTIONS</a> | <a href="https://huggingface.co/models?sort=trending&search=DavidAU" target="_blank">TRENDING</a> | <a href="https://huggingface.co/DavidAU/support" target="_blank">FAQs</a> | <a href="https://huggingface.co/DavidAU/support" target="_blank">SUPPORT</a> | <a href="https://buymeacoffee.com/davidbelton" target="_blank">Buy Me A Coffee (😁)</a></small>
<h2> Ultra High Quality - 20 B Dark Forest Version 3.0 - 32 bit upscale </h2>Fully rebuilt from master files, including full merge(s) to maintain full 32 bit precision right up until it is compressed into GGUF files which results on a top to bottom upgrade.
The result is superior performance in instruction following, reasoning, depth, nuance and emotion.
NOTE: There are three original versions of "Dark Forest 20B", this is an upscale of the third version, with links below to 1st and 2nd versions also upscaled.
<img src="dark-forest.jpg">On average this means a q4km operates at Q6 levels and Q6 and Q8 exceeds original model full precision performance.
Perplexity drop (lower is better) is close to 10% (over 752 points for q4km) for all quants.
That means precision has been enhanced for all 20 billion parameters which affects "brain density" / "function", instruction following and output quality.
Imatrix quants to follow shortly.
<B>Settings: CHAT / ROLEPLAY and/or SMOOTHER operation of this model:</B>
In "KoboldCpp" or "oobabooga/text-generation-webui" or "Silly Tavern" ;
Set the "Smoothing_factor" to 1.5 to 2.5
: in KoboldCpp -> Settings->Samplers->Advanced-> "Smooth_F"
: in text-generation-webui -> parameters -> lower right.
: In Silly Tavern this is called: "Smoothing"
NOTE: For "text-generation-webui"
-> if using GGUFs you need to use "llama_HF" (which involves downloading some config files from the SOURCE version of this model)
Source versions (and config files) of my models are here:
OTHER OPTIONS:
Increase rep pen to 1.1 to 1.15 (you don't need to do this if you use "smoothing_factor")
If the interface/program you are using to run AI MODELS supports "Quadratic Sampling" ("smoothing") just make the adjustment as noted.
For more details, including a list of enhancements see our other 32 bit upscale of "Space Whale 20B" rebuild here:
[ https://huggingface.co/DavidAU/Psyonic-Cetacean-Ultra-Quality-20b-GGUF ]
For Version 1 of Dark Forest Ultra Quality 32 bit upscale please go here:
[ https://huggingface.co/DavidAU/Dark-Forest-V1-Ultra-Quality-20b-GGUF ]
For Version 1 of Dark Forest Ultra Quality 32 bit upscale please go here:
[ https://huggingface.co/TeeZee/DarkForest-20B-v2.0 ]
Special thanks to "TEEZEE" for making a both fantasic models of "Dark Forest".
<b> Info from the original model card: </B>
Warning: This model can produce NSFW content!
Results:
- main difference to v1.0 - model has much better sense of humor.
- produces SFW nad NSFW content without issues, switches context seamlessly.
- good at following instructions.
- good at tracking multiple characters in one scene.
- very creative, scenarios produced are mature and complicated, model doesn't shy from writing about PTSD, menatal issues or complicated relationships.
- NSFW output is more creative and suprising than typical limaRP output.
- definitely for mature audiences, not only because of vivid NSFW content but also because of overall maturity of stories it produces.
- This is NOT Harry Potter level storytelling.
For original model spec and information please visit:
[ https://huggingface.co/TeeZee/DarkForest-20B-v3.0 ]
<B>Highest Quality Settings / Optimal Operation Guide / Parameters and Samplers</B>
This a "Class 2" model:
For all settings used for this model (including specifics for its "class"), including example generation(s) and for advanced settings guide (which many times addresses any model issue(s)), including methods to improve model performance for all use case(s) as well as chat, roleplay and other use case(s) please see:
Special thanks to all the following, and many more...
All the model makers, fine tuners, mergers, and tweakers:
Huggingface [ https://huggingface.co ] :
LlamaCPP [ https://github.com/ggml-org/llama.cpp ] :
Quant-Masters: Team Mradermacher, Bartowski, and many others:
MergeKit [ https://github.com/arcee-ai/mergekit ] :
Lmstudio [ https://lmstudio.ai/ ] :
Text Generation Webui // KolboldCPP // SillyTavern: