Downloads · 30 days
31
14% of all-time downloads
hunter87/Qwen3-ASR-0.6B-GGUF
Qwen3-ASR-0.6B-GGUF is a machine learning model from hunter87. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Downloads · 30 days
31
14% of all-time downloads
All-time downloads
214
Public
Repo size
699 MB
Likes
0
Public
Click a slice to open those files.
.gguf699 MB · 100%
From the Hugging Face model README
llama-server -hf ggml-org/Qwen3-ASR-0.6B-GGUF
for minimal usecase
llama-server -hf hunter87/Qwen3-ASR-0.6B-GGUF -c 512 -np 1 -b 32 -ub 32 --flash-attn on --n-gpu-layers 999 --no-mmap -t 2