Downloads · 30 days
45
6% of all-time downloads
ttrpg/Mistral-7B-v0.3-gguf
Mistral-7B-v0.3-gguf is a machine learning model from ttrpg. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
Downloads · 30 days
45
6% of all-time downloads
All-time downloads
774
Public
Repo size
41.1 GB
Likes
0
Public
Click a slice to open those files.
.gguf41.1 GB · 100%
From the Hugging Face model README
./llama-server \
--port 1234 \
--host 0.0.0.0 \
--gpu-layers 99 \
--alias ttrpg/Mistral-7B-v0.3 \
--ctx-size 32768 \
--chat-template mistral-v3 \
-hf ttrpg/Mistral-7B-v0.3-gguf:Q4_K_M