qwen3.5-9B-super-coder-Q3KM-GGUF

🚀 Qwen 3.5 9B Super-Coder (Phase 4 Specialized - GGUF)

Quantized GGUF weights of jica98/qwen3.5-9b-phase4-specialize-lora merged directly with Qwen/Qwen3.5-9B-Base in full FP16 precision, then quantized via llama.cpp K-Quants. Specialized for Fullstack Software Engineering, Autonomous Agentic Tool Calling, and Complex Code Reasoning.

🌟 Model Highlights

• 🧠 9-Billion Parameter Intelligence: Powered by Phase 4 specialization, Claude distillation, and Fable reasoning traces for deep architectural and algorithmic tasks.
• ⚡ Next-Gen Hybrid Architecture: Built on Qwen 3.5's Gated DeltaNet SSM + Gated Attention, providing blazing fast inference and linear memory scaling.
• 🛡️ 1-Pass Clean Quantization: Merged directly in FP16 to prevent double-quantization degradation and eliminate repetition loops on DeltaNet SSM tensors.
• 🧰 Native Agentic Tool Calling: Highly attuned for OpenAI-compatible function calling (write_file, replace_lines, run_terminal_command).
• 🌐 Multilingual & Fullstack Mastery: TypeScript, React, Next.js, Python, Rust, Go, C++, SQL, and Shell scripting.

---

📊 Quantization Breakdown & Hardware Compatibility

[!NOTE] Standard K-Quants (Q3_K_M, Q3_K_S, Q2_K) are used instead of legacy IQ quants to ensure 100% stability across Qwen 3.5's hybrid DeltaNet state-space layers.

---

💻 Quickstart & How to Run

1. In Unsloth Studio / Desktop

1. Open Unsloth Studio $\to$ Navigate to Model Hub.
2. Search for khoin68/qwen3.5-9B-super-coder-Q3KM-GGUF.
3. Select your preferred quant (e.g. Q3_K_M) and click Download $\to$ Load.

2. In LM Studio

1. Search khoin68/qwen3.5-9B-super-coder-Q3KM-GGUF.
2. Download the .gguf file and start the local server on port 1234 or 8888.

3. In llama.cpp CLI / Server

# Run local OpenAI-compatible inference server
llama-server -m qwen3.5-9B-super-coder.Q3_K_M.gguf -c 24000 --port 8888 -ngl 99

1. In Python via llama-cpp-python

from llama_cpp import Llama
llm = Llama(
    model_path="qwen3.5-9B-super-coder.Q3_K_M.gguf",
    n_ctx=24000,
    n_gpu_layers=-1, # Offload all layers to GPU
    verbose=False
)
response = llm.create_chat_completion(
    messages=[
        {"role": "system", "content": "You are an expert software engineer."},
        {"role": "user", "content": "Write a clean TypeScript debounce utility with cancel support."}
    ]
)
print(response["choices"][0]["message"]["content"])

📝 Prompt Format (ChatML)

<|im_start|>system
You are an autonomous AI coding assistant.<|im_end|>
<|im_start|>user
{prompt}<|im_end|>
<|im_start|>assistant

📜 Credits & Acknowledgements Base Architecture: Alibaba Cloud Qwen Team (Qwen/Qwen3.5-9B-Base) Phase 4 LoRA Specialization: @jica98 (jica98/qwen3.5-9b-phase4-specialize-lora) FP16 Clean Merge & GGUF Quantization: @khoin68