Downloads · 30 days
173
4% of all-time downloads
Tess-3-7B-SFT-GGUF
juvi21/Tess-3-7B-SFT-GGUF
Tess-3-7B-SFT-GGUF is a machine learning model from juvi21. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
I used <a href="https://github.com/ggerganov/llama.cpp/"llama.cpp</a release <a href="https://github.com/ggerganov/llama.cpp/releases/tag/b3166"b3166</a for making several quants for the FLOP poor. Visit the OG model…
All-time downloads
4.3K
Public
Repo size
65.4 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf65.4 GB · 100%
At a glance
- Access
- Public
- Created
- Jul 22, 2024
- Updated
- Jul 22, 2024
- SHA
- 83fb9629
Base models
Model card
From the Hugging Face model README
Tess-3-7B-SFT-GGUF Quants
I used <a href="https://github.com/ggerganov/llama.cpp/">llama.cpp</a> release <a href="https://github.com/ggerganov/llama.cpp/releases/tag/b3166">b3166</a> for making several quants for the FLOP poor. Visit the OG model card for more details: https://huggingface.co/migtissera/Tess-3-7B-SFT
Quants
| Filename | Quant type | File Size |
|---|---|---|
| Tess-3-7B-SFT-f16.gguf | F16 | 14.5 GB |
| Tess-3-7B-SFT-gguf-q8_0.gguf | Q8_0 | 7.7 GB |
| Tess-3-7B-SFT-gguf-q6_k.gguf | Q6_K | 5.95 GB |
| Tess-3-7B-SFT-gguf-q5_k_s.gguf | Q5_K_S | 5 GB |
| Tess-3-7B-SFT-gguf-q4_k_m.gguf | Q4_K_M | 4.37 GB |
| Tess-3-7B-SFT-gguf-q4_k_s.gguf | Q4_K_S | 4.14 GB |
| Tess-3-7B-SFT-gguf-iq4_xs.gguf | IQ4_XS | 3.95 GB |
| Tess-3-7B-SFT-gguf-q3_k_l.gguf | Q3_K_L | 3.83 GB |
| Tess-3-7B-SFT-gguf-q3_k_m.gguf | Q3_K_M | 3.52 GB |
| Tess-3-7B-SFT-gguf-iq3_m.gguf | IQ3_M | 3.29 GB |
| Tess-3-7B-SFT-gguf-q3_k_s.gguf | Q3_K_S | 3.17 GB |
| Tess-3-7B-SFT-gguf-iq3_xs.gguf | IQ3_XS | 3.02 GB |
| Tess-3-7B-SFT-gguf-q2_k.gguf | Q2_K | 2.72 GB |
| Tess-3-7B-SFT-gguf-iq3_xxs.gguf | IQ3_XXS | 136 MB |
| Tess-3-7B-SFT-gguf-iq2_m.gguf | IQ2_M | 83.7 MB |
Downloading using huggingface-cli
pip install -U "huggingface_hub[cli]"
huggingface-cli download juvi21/Tess-3-7B-SFT-GGUF --include "Tess-3-7B-SFT-gguf-q4_k_m.gguf" --local-dir ./
- Created
- Jul 22, 2024
- Updated
- Jul 22, 2024