Downloads · 30 days
35
1% of all-time downloads
nakodanei/ShareGPT4V-7B_GGUF
ShareGPT4V-7B_GGUF is a machine learning model from nakodanei. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as llama2.
GGUF quantisation of https://huggingface.co/Lin-Chen/ShareGPT4V-7B
Downloads · 30 days
35
1% of all-time downloads
All-time downloads
2.7K
Public
Repo size
5.4 GB
Likes
12
Public
Click a slice to open those files.
.gguf5.4 GB · 100%
From the Hugging Face model README
GGUF quantisation of https://huggingface.co/Lin-Chen/ShareGPT4V-7B
You can run the model with llama.cpp server, then visit the server webpage to upload an image. Example:
.\server.exe -m ".\models\ShareGPT4V-7B_Q5_K_M.gguf" -t 6 -c 4096 -ngl 26 --mmproj ".\models\mmproj-model-f16.gguf"