Downloads · 30 days
116
3% of all-time downloads
Lewdiculous/Test2_SLIDE-GGUF-IQ-Imatrix
Test2_SLIDE-GGUF-IQ-Imatrix is a machine learning model from Lewdiculous. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
GGUF-IQ-Imatrix quants for NLPark/Test1SLIDE as requested in 28.
Downloads · 30 days
116
3% of all-time downloads
All-time downloads
4.3K
Public
Repo size
71.9 GB
Likes
2
Public
Click a slice to open those files.
.gguf71.9 GB · 100%
From the Hugging Face model README
GGUF-IQ-Imatrix quants for NLPark/Test1_SLIDE as requested in #28.
[!WARNING] Recommended presets here or here. <br> Use the latest version of KoboldCpp. Use the provided presets. <br> This is all still highly experimental, modified configs were used to avoid the tokenizer issues.
"Due to the poor performance of Test0 in Asian Languages, we trained a new preview model."
"It's a merge of https://huggingface.co/NLPark/Test1_SLIDE , https://huggingface.co/vicgalle/Configurable-Llama-3-8B-v0.3"
"The chat template of our chat models is similar as Llama3."
