Downloads · 30 days
58
4% of all-time downloads
phnxsystms/Qwen3-Omni-30B-A3B-Instruct-GGUF
Qwen3-Omni-30B-A3B-Instruct-GGUF is a machine learning model from phnxsystms. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Quantized GGUF models for Qwen3-Omni multimodal LLM.
Downloads · 30 days
58
4% of all-time downloads
All-time downloads
1.5K
Public
Repo size
32.5 GB
Likes
0
Public
Click a slice to open those files.
.gguf65 GB · 100%
From the Hugging Face model README
Quantized GGUF models for Qwen3-Omni multimodal LLM.
| File | Size | Description |
|---|---|---|
qwen3-omni-30B-Q8_0.gguf | 31GB | Main LLM (Q8_0 quantization) |
mmproj-qwen3-omni-30B-F16-fixed.gguf | 2.3GB | Vision projector (F16) |
Requires custom llama.cpp build with Qwen3-Omni support:
# Clone the fork with Qwen3-Omni support
git clone https://github.com/phnxsystms/llama.cpp.git
cd llama.cpp
git checkout qwen3omni
# Build
mkdir build && cd build
cmake .. -DGGML_CUDA=ON
cmake --build . -j
# Run text inference
./bin/llama-cli -m qwen3-omni-30B-Q8_0.gguf -p "Hello!" -ngl 99
# Run multimodal inference
./bin/llama-mtmd-cli -m qwen3-omni-30B-Q8_0.gguf --mmproj mmproj-qwen3-omni-30B-F16-fixed.gguf --image your_image.jpg -p "Describe this image"
The Qwen3-Omni architecture support is available at:
qwen3omniApache 2.0 (same as original Qwen3-Omni model)