Downloads · 30 days
145
23% of all-time downloads
callgg/qwen3.8-27b-gguf
qwen3.8-27b-gguf is a machine learning model from callgg. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
- execute tools and/or agentic workflow - fit in 12GB vram/ram or less
Downloads · 30 days
145
23% of all-time downloads
All-time downloads
620
Public
Repo size
11.2 GB
Likes
2
Public
Click a slice to open those files.
.gguf11.2 GB · 100%
From the Hugging Face model README
run it with ggk
ggk server engine -- -m qwen3.8-27b-q2_k_s.gguf --mmproj mmproj-qwen3.8-27b-q4_0.gguf --jinja --spec-type draft-mtp -md mtp-qwen3.8-27b-q4_0.gguf --spec-draft-n-max 2 --parallel 1 -ts 1,0
or run it with llama.cpp
./llama-server -m qwen3.8-27b-q2_k_s.gguf --mmproj mmproj-qwen3.8-27b-q4_0.gguf --jinja --spec-type draft-mtp -md mtp-qwen3.8-27b-q4_0.gguf --spec-draft-n-max 2 --parallel 1 --host 127.0.0.1 --port 8888
or opt lmstudio, etc.