Downloads · 30 days
1.9K
3% of all-time downloads
Lewdiculous/CaptainErisNebula-12B-Chimera-v1.1-GGUF-IQ-Imatrix
CaptainErisNebula-12B-Chimera-v1.1-GGUF-IQ-Imatrix is a machine learning model from Lewdiculous. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as other.
[!TIP] GGUF quants for Nitral-AI/CaptainErisNebula-12B-Chimera-v1.1's recipe.
Downloads · 30 days
1.9K
3% of all-time downloads
All-time downloads
58.5K
Public
Repo size
152 GB
Likes
28
Public
Click a slice to open those files.
.gguf152 GB · 100%
From the Hugging Face model README
[!TIP]
GGUF quants for Nitral-AI/CaptainErisNebula-12B-Chimera-v1.1's recipe.
[!IMPORTANT] Author recommended initial SillyTavern presets: <br>

<hr>[!NOTE]
This is an improvement on the previous experimental version. <br>
- Not "chaotic", and at a usable size for most people seeking to perform inference locally with good speeds. <br>
- The model does not show excessive alignment, so it should be good for most scenarios/writing situations. <br> <br>
- Feel free to use some light system prompting to nudge it out of a blocker if needed. <br> <br>
- It does well in adhering to characters and instructions. <br> <br>
Thank you so much, "crazy chef" and "mad scientist", Nitral!
<!--  --> <br># Using the latest llama.cpp ...
release version at the time: b6258.
# Imatrix was based on the full ...
FP16 precision GGUF.
START: BF16 HuggingFace Model
↓
(1) Conversion to Full-Precision GGUF
↓
FP16 GGUF (for Calibration Imatrix)
BF16 GGUF (for Quantization)
↓
(2) Generate Imatrix (from FP16 GGUF)
↓
imatrix.fp16.gguf
↓
(3) Quantize with Imatrix (using BF16 GGUF)
↓
Final Quantized GGUF Models
↓
END