Downloads · 30 days
509
23% of all-time downloads
DavidAU/LFM2-12B-A1B-SpeedDemon-The-Deckard-II-HERETIC-Uncensored
LFM2-12B-A1B-SpeedDemon-The-Deckard-II-HERETIC-Uncensored is a text generation model from DavidAU. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
<small<B style="font-family: 'Arial Black', sans-serif; font-weight: 900; color: f1c40f; text-decoration: none; text-shadow: 1px 1px 0 d35400, 2px 2px 0 d35400, 3px 3px 0 d35400, 4px 4px 0 d35400, 5px 5px 0 d35400, 6p…
Downloads · 30 days
509
23% of all-time downloads
All-time downloads
2.2K
Public
Parameters
11.3B
22.6 GB on disk
Likes
14
Public
Click a slice to open those files.
.safetensors22.6 GB · 100%
How the weights are stored.
BF1611.3B · 100%
From the Hugging Face model README
<small><B style="font-family: 'Arial Black', sans-serif; font-weight: 900; color: #f1c40f; text-decoration: none; text-shadow: 1px 1px 0 #d35400, 2px 2px 0 #d35400, 3px 3px 0 #d35400, 4px 4px 0 #d35400, 5px 5px 0 #d35400, 6px 6px 7px rgba(0,0,0,0.4);">[DavidAU]</B> <a href="https://huggingface.co/DavidAU" target="_blank" style="padding-left:5px">FOLLOW</a> | <a href="https://huggingface.co/DavidAU" target="_blank">ALL MODELS</a> | <a href="https://huggingface.co/DavidAU/collections" target="_blank">COLLECTIONS</a> | <a href="https://huggingface.co/models?sort=trending&search=DavidAU" target="_blank">TRENDING</a> | <a href="https://huggingface.co/DavidAU/support" target="_blank">FAQs</a> | <a href="https://huggingface.co/DavidAU/support" target="_blank">SUPPORT</a> | <a href="https://buymeacoffee.com/davidbelton" target="_blank">Buy Me A Coffee (😁)</a></small>
<h2>LFM2-12B-A1B-SpeedDemon-The-Deckard-II-HERETIC-Uncensored</h2>Fine tune of EXPANDED "LFM2-8B-A1B" to "LFM2-12B-A1B" (almost 50%, custom scripting) using Unsloth using custom dataset(s), 128k context in 16 bit precision.
Expands base model from 24 to 32 layers, 256 to 342 tensors to give the model both more knowledge and brainpower.
Trained on Deckard II [5 datasets, in house]:
Excels at long form creative generation. Very intelligent too.
This is full uncensored version (uncensored first, trained second)
This model is a sparse mixture of experts model (32) with 4 experts activated.
Speed exceeds 50-100 t/s on CPU // 200 t/s on most cards // 400 t/s + on 5090 at QUANT Q6K [4 experts].
One example generation below.
Can also be used on phones // mobile devices.
IN HOUSE BENCHMARKS [by Nightmedia]:
arc-c arc/e boolq hswag obkqa piqa wino
LFM2-12B-A1B-SpeedDemon-The-Deckard-II-HERETIC-Uncensored
bf16 0.469,0.612,0.782,0.676,0.412,0.743,0.610
---
BASE UNTUNED MODEL:
LFM2-8B-A1B
bf16 0.464,0.583,0.826,0.624,0.398,0.717,0.575
mxfp8 0.460,0.575,0.829,0.624,0.394,0.711,0.567