Downloads · 30 days
27.8K
75% of all-time downloads
presencesw/Qwen3-Omni-30B-A3B-Captioner-GGUF
Qwen3-Omni-30B-A3B-Captioner-GGUF is a image-text-to-text model from presencesw. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for llama.cpp. The card lists the license as apache-2.0.
GGUF conversion of Qwen/Qwen3-Omni-30B-A3B-Captioner for experimental audio captioning with llama.cpp.
Downloads · 30 days
27.8K
75% of all-time downloads
All-time downloads
36.8K
Public
Repo size
20.8 GB
Likes
3
Public
Click a slice to open those files.
.gguf20.8 GB · 100%
From the Hugging Face model README
GGUF conversion of Qwen/Qwen3-Omni-30B-A3B-Captioner for experimental audio captioning with llama.cpp.
| File | Size | SHA-256 |
|---|---|---|
Qwen3-Omni-30B-A3B-Captioner-Q4_K_M.gguf | 17.7 GiB | f6b443caefee34c82edc51278bbd410ad58146baf6fca53d09035322300034cf |
mmproj-Qwen3-Omni-30B-A3B-Captioner-BF16.gguf | 2.1 GiB | 81d4d92662eb7f387f09b0a6679e945bf61dd0f2ef5ab8d36be6cc9580bb6252 |
The Q4_K_M model and BF16 multimodal projector were tested together with llama-mtmd-cli on an audio sample. The audio encoder processed all five chunks and generated a caption.
Use a recent llama.cpp build with audio multimodal support:
llama-mtmd-cli \
-m Qwen3-Omni-30B-A3B-Captioner-Q4_K_M.gguf \
--mmproj mmproj-Qwen3-Omni-30B-A3B-Captioner-BF16.gguf \
--audio sample.mp3 \
-p "Describe this audio."
Audio support in llama.cpp remains experimental. Captioner is designed for one audio input and text output.