Downloads · 30 days
443
5% of all-time downloads
Test1_SLIDE-GGUF-IQ-Imatrix
Lewdiculous/Test1_SLIDE-GGUF-IQ-Imatrix
Test1_SLIDE-GGUF-IQ-Imatrix is a machine learning model from Lewdiculous. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
GGUF-IQ-Imatrix quants for NLPark/Test1SLIDE as requested in 27.
All-time downloads
8.6K
Public
Repo size
144 GB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.gguf72 GB · 100%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Apr 22, 2024
- Updated
- May 2, 2024
- SHA
- b4b0e871
Model card
From the Hugging Face model README
GGUF-IQ-Imatrix quants for NLPark/Test1_SLIDE as requested in #27.
[!IMPORTANT]
Updated! These quants have been redone with the fixes from llama.cpp/pull/6920 in mind. <br> Use KoboldCpp version 1.64 or higher.
[!WARNING] Recommended presets here or here. <br> Use the latest version of KoboldCpp. Use the provided presets. <br> This is all still highly experimental, modified configs were used to avoid the tokenizer issues.
"Due to the poor performance of Test0 in Asian Languages, we trained a new preview model."
"This's NLPark's 8B chat model."
"The chat template of our chat models is similar as Llama3."
- License
- apache-2.0
- Created
- Apr 22, 2024
- Updated
- May 2, 2024