Downloads · 30 days
30
18% of all-time downloads
RockMan256/Qwen3.5-2B-fullRC-GGUF
Qwen3.5-2B-fullRC-GGUF is a machine learning model from RockMan256. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
GGUF conversion of RockMan256/Qwen3.5-2B-fullRC.
Downloads · 30 days
30
18% of all-time downloads
All-time downloads
166
Public
Repo size
2 GB
Likes
0
Public
Click a slice to open those files.
.gguf2 GB · 100%
From the Hugging Face model README
GGUF conversion of RockMan256/Qwen3.5-2B-fullRC.
| File | Description | Size |
|---|---|---|
qwen3.5-2B-fullRC-Q4_K_M.gguf | LLM weights in Q4_K_M | 1.24 GB |
mmproj-model-f16.gguf | Vision projector (mmproj) in F16 | 668 MB |
# Build llama.cpp (if not already built)
cd llama.cpp && make -j
# Run with multimodal (image + text) inference
./llama-mtmd-cli \
-m qwen3.5-2B-fullRC-Q4_K_M.gguf \
--mmproj mmproj-model-f16.gguf \
--chat-template chatml
# Text-only inference (no vision)
echo "What is the capital of France?" | ./llama-mtmd-cli \
-m qwen3.5-2B-fullRC-Q4_K_M.gguf \
-p - --chat-template chatml
Apache 2.0 (same as base model)