Downloads · 30 days
846
19% of all-time downloads
duyntnet/Stanta-Lelemon-Maid-7B-imatrix-GGUF
Stanta-Lelemon-Maid-7B-imatrix-GGUF is a text generation model from duyntnet. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
Quantizations of https://huggingface.co/ChaoticNeutrals/Stanta-Lelemon-Maid-7B
Downloads · 30 days
846
19% of all-time downloads
All-time downloads
4.3K
Public
Repo size
99.9 GB
Likes
0
Public
Click a slice to open those files.
.gguf99.9 GB · 100%
From the Hugging Face model README
Quantizations of https://huggingface.co/ChaoticNeutrals/Stanta-Lelemon-Maid-7B

If you want to use vision functionality:
To use the multimodal capabilities of this model and use vision you need to load the specified mmproj file, this can be found inside this model repo.

Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 69.79 |
| AI2 Reasoning Challenge (25-Shot) | 67.58 |
| HellaSwag (10-Shot) | 86.03 |
| MMLU (5-Shot) | 64.79 |
| TruthfulQA (0-shot) | 59.58 |
| Winogrande (5-shot) | 79.64 |
| GSM8k (5-shot) | 61.11 |