Downloads · 30 days
5
1% of all-time downloads
mesolitica/llava-v1.6-34b-hf-awq
llava-v1.6-34b-hf-awq is a image-text-to-text model from mesolitica. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for transformers.
You need to use this forked, https://github.com/WanBenLe/AutoAWQ-with-llava-v1.6
Downloads · 30 days
5
1% of all-time downloads
All-time downloads
562
Public
Parameters
34.8B
20 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors20 GB · 100%
How the weights are stored.
I3233.5B · 96%
From the Hugging Face model README
You need to use this forked, https://github.com/WanBenLe/AutoAWQ-with-llava-v1.6