Downloads · 30 days
1.6K
8% of all-time downloads
llama-4-scout-17b-16e-it-gguf
chatpig/llama-4-scout-17b-16e-it-gguf
llama-4-scout-17b-16e-it-gguf is a image-text-to-text model from chatpig. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. The card lists the license as other.
- base model from meta-llama - tested on gguf-connector with nightly llama-cpp-python
All-time downloads
19.6K
Public
Repo size
768 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf541 GB · 100%
At a glance
- Task
- Image-Text-to-Text
- License
- other
- Access
- Public
- Created
- Apr 8, 2025
- Updated
- Apr 13, 2025
- SHA
- 78f4bb5b
Try a prompt
Base models
Model card
From the Hugging Face model README
llama-4-scout-17b-16e-instruct-gguf
- base model from meta-llama
- tested on gguf-connector with nightly llama-cpp-python
example workflow (run it locally)
- download the different parts of the model; for example q2_k
llama-4-scout-17b-16e-it-q2_k-00001-of-00004.ggufllama-4-scout-17b-16e-it-q2_k-00002-of-00004.ggufllama-4-scout-17b-16e-it-q2_k-00003-of-00004.ggufllama-4-scout-17b-16e-it-q2_k-00004-of-00004.gguf- pull them all into an empty folder; then execute the merge command:
ggc m2 - the merged gguf is around 36.8GB for q2_k (setup once)
- execute connector command:
ggc gpporggc cpp - select the merged gguf then start your prompt to interact with llama4
for model larger than 50GB in total
- don't need to merge (linked already); just execute:
ggc gpp(orggc cppfor ui) - select the first part of the model (i.e., 00001-of-xxxxx)
- start your prompt to interact with llama4
- Task
- Image-Text-to-Text
- License
- other
- Created
- Apr 8, 2025
- Updated
- Apr 13, 2025