Downloads · 30 days
17
0% of all-time downloads
Nous-Hermes-2-Vision-Alpha-GGUF
cmp-nct/Nous-Hermes-2-Vision-Alpha-GGUF
Nous-Hermes-2-Vision-Alpha-GGUF is a machine learning model from cmp-nct. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Origin: https://huggingface.co/NousResearch/Nous-Hermes-2-Vision-Alpha This is the quantized GGUF version of a function calling fine tuned llava-type model using a tiny Vision tower.
All-time downloads
7.4K
Public
Repo size
6 GB
Likes
4
Public
Repo makeup
Click a slice to open those files.
Other5.1 GB · 86%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Dec 9, 2023
- Updated
- Dec 9, 2023
- SHA
- 516f14cb
Model card
From the Hugging Face model README
Origin: https://huggingface.co/NousResearch/Nous-Hermes-2-Vision-Alpha This is the quantized GGUF version of a function calling fine tuned llava-type model using a tiny Vision tower.
Sharing it because it's novel and it has beene a pain to convert \build\bin\Release\llava-cli.exe -m Q:\models\llava\Nous-Hermes-2-Vision\ggml-model-q5_k --mmproj Q:\models\llava\Nous-Hermes-2-Vision\mmproj-model-f16.gguf -ngl 80 -p 1025 --image path/to/image -p "Describe the image (use the proper syntax)"
If you wish to quantize yourself you currently need this PR: https://github.com/ggerganov/llama.cpp/pull/4313
Warning: The model is not very good at this point - mostly for testing purposes
- License
- apache-2.0
- Created
- Dec 9, 2023
- Updated
- Dec 9, 2023