Downloads · 30 days
234
2% of all-time downloads
Lewdiculous/L3-TheSpice-8b-v0.1.3-GGUF-IQ-Imatrix
L3-TheSpice-8b-v0.1.3-GGUF-IQ-Imatrix is a machine learning model from Lewdiculous. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as cc-by-4.0.
GGUF-IQ-Imatrix quants for cgato/L3-TheSpice-8b-v0.1.3.
Downloads · 30 days
234
2% of all-time downloads
All-time downloads
12.3K
Public
Repo size
137 GB
Likes
11
Public
Click a slice to open those files.
.gguf68.3 GB · 100%
From the Hugging Face model README
GGUF-IQ-Imatrix quants for cgato/L3-TheSpice-8b-v0.1.3.
[!IMPORTANT]
These quants have been done after the fixes from llama.cpp/pull/6920. <br> Use KoboldCpp version 1.64 or higher.
[!NOTE] Prompt formatting... <br> Prompt format is relatively simple, author seems to recommend the Default context preset and Instruct Mode - Disabled. <br> I recommend reading original model card page information.
