Downloads · 30 days
20
6% of all-time downloads
RockMan256/Qwen3.5-2B-home16k-GGUF
Qwen3.5-2B-home16k-GGUF is a machine learning model from RockMan256. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for llama-cpp.
GGUF quantizations of RockMan256/Qwen3.5-2B-home16k.
Downloads · 30 days
20
6% of all-time downloads
All-time downloads
324
Public
Repo size
5.5 GB
Likes
0
Public
Click a slice to open those files.
.gguf2 GB · 100%
From the Hugging Face model README
GGUF quantizations of RockMan256/Qwen3.5-2B-home16k.
Converted using llama.cpp.
| File | Type | Size |
|---|---|---|
qwen3.5-2B-home16k-Q4_K_M.gguf | Text model (Q4_K_M) | 1.3 GB |
mmproj-model-f16.gguf | Vision projector (F16) | 638 MB |
./llama-server \
-m qwen3.5-2B-home16k-Q4_K_M.gguf \
--mmproj mmproj-model-f16.gguf \
--host 0.0.0.0 --port 8080
qwen3.5-2B-home16k-Q4_K_M.gguf and mmproj-model-f16.gguf