Downloads · 30 days
41
3% of all-time downloads
andy300/Teuken-7B-instruct-v0.6-SP-GGUF
Teuken-7B-instruct-v0.6-SP-GGUF is a machine learning model from andy300. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
Teuken-7B-instruct-v0.6-SP-GGUF ===============================
Downloads · 30 days
41
3% of all-time downloads
All-time downloads
1.5K
Public
Repo size
19.9 GB
Likes
0
Public
Click a slice to open those files.
.gguf19.9 GB · 100%
From the Hugging Face model README
Teuken-7.5B-BF16-CM.gguf is the exact clone of Teuken 7B for the llama.cpp with sentencepiece inference engine.
Teuken-7.5B-Q4_K_M.gguf is a Q4_K_M 4 Bit quantized version of Teuken-7.5B-BF16-CM.gguf for llama.cpp with sentencepiece inference engine.
llama.cpp with sentencepiece is a fork of llama.cpp using sentencepiece tokenizer as external library. Additionally Teuken 7B is supported.