Downloads · 30 days
53
3% of all-time downloads
euclaise-Memphis-scribe-3B-GGUF-iMatrix
Green-Sky/euclaise-Memphis-scribe-3B-GGUF-iMatrix
euclaise-Memphis-scribe-3B-GGUF-iMatrix is a machine learning model from Green-Sky. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as cc-by-4.0.
llama.cpp conversion of https://huggingface.co/euclaise/Memphis-scribe-3B
All-time downloads
1.6K
Public
Repo size
16.2 GB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.gguf16.2 GB · 100%
At a glance
- Library
- transformers
- License
- cc-by-4.0
- Access
- Public
- Created
- Feb 7, 2024
- Updated
- Feb 8, 2024
- SHA
- fbf35f6c
Base models
Model card
From the Hugging Face model README
llama.cpp conversion of https://huggingface.co/euclaise/Memphis-scribe-3B
except for f16 and q8_0, every quant is using the imatrix from wiki-train
ppl (512 wiki.test)
| quant | ppl (lower is better) |
|---|---|
| f16(baseline) | 9.9437 +/- 0.07019 |
| q8_0 | 9.9474 +/- 0.07022 |
| q5_k_m | 10.0347 +/- 0.07091 |
| q4_k_m | 10.1192 +/- 0.07152 |
| iq3_xxs | 11.5266 +/- 0.08157 |
| q2_k | 13.0623 +/- 0.09548 |
| iq2_xs | 16.6174 +/- 0.11807 |
| iq2_xxs | 22.6462 +/- 0.16226 |
- Library
- transformers
- License
- cc-by-4.0
- Languages
- en
- Created
- Feb 7, 2024
- Updated
- Feb 8, 2024