Downloads · 30 days
19
0% of all-time downloads
nakodanei/ShareGPT4V-13B_GGUF
ShareGPT4V-13B_GGUF is a machine learning model from nakodanei. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as llama2.
GGUF quantisation of https://huggingface.co/Lin-Chen/ShareGPT4V-13B
Downloads · 30 days
19
0% of all-time downloads
All-time downloads
10.1K
Public
Repo size
8.5 GB
Likes
7
Public
Click a slice to open those files.
.gguf8.5 GB · 100%
From the Hugging Face model README
GGUF quantisation of https://huggingface.co/Lin-Chen/ShareGPT4V-13B
You can run the model with llama.cpp server, then visit the server webpage to upload an image. Example:
.\server.exe -m ".\models\ShareGPT4V-13B-Q4_K_M.gguf" -t 6 -c 4096 -ngl 26 --mmproj ".\models\mmproj-model-f16.gguf"
A low temperature is recommended.