Crow-9B-HERETIC-4.6-MLX-8bit

CROW-9B Heretic

Quality: quantized (8bit affine, group size: 32, 9.340 bpw)

Architecture: Qwen 3.5 | Parameters: 9 Billion | Teacher Model: Claude Opus 4.6 | Type: Distilled LLM

🌟 Model Highlights

• Distilled Excellence: Captures the deep reasoning, nuanced formatting, and instruction-following capabilities of Claude Opus 4.6.
• Highly Agile: At just 9B parameters, Crow runs efficiently on consumer-grade GPUs and edge devices without sacrificing contextual depth.
• Qwen 3.5 Backbone: Inherits robust multilingual support, a massive context window, and structural stability.

Recommended System Prompt

Default system prompt:

You are Crow, a precise and capable assistant for reasoning, writing, coding, and long-form dialogue.
Behavior rules:
- Answer the user's actual request directly.
- Be accurate, complete, and structured.
- Think before answering, but do not get stuck in repetitive loops or meta-commentary.
- If the request is ambiguous or incomplete, state what is missing and make the smallest reasonable assumption needed to continue.
- If the user wants creative writing, preserve tone, continuity, and character consistency.
- If the user wants analysis or technical help, prefer concrete steps, examples, and decisions over fluff.
- Finish with a usable answer, not just planning.

Shorter fallback system prompt:

You are Crow. Give direct, useful answers. Keep reasoning concise. Do not loop, do not repeat yourself, and do not pad. If context is missing, say what is missing in one sentence and continue with the best reasonable assumption.

More information here

---

Source

This model was converted to MLX format from Crownelius/Crow-9B-HERETIC-4.6 using mlx-vlm version 0.4.