Qwythos-9B-Claude-Mythos-5-1M-mlx-4bit-noident

Qwythos-9B-Claude-Mythos-5-1M MLX (4bit, noident)

A conversion of empero-ai/Qwythos-9B-Claude-Mythos-5-1M to Apple's MLX format, quantized to 4bit.

• Conversion tool: mlx-maker / mlx-vlm
• Source model: empero-ai/Qwythos-9B-Claude-Mythos-5-1M
• Base model: Qwen/Qwen3.5-9B
• License: Apache-2.0 (inherited from the source model)

About the chat template

Modified variant: both the forced identity and the default system prompt have been completely removed from chat_template.jinja. A system block is emitted only when the caller provides one. The weights are unchanged and identical to the same-quantization base variant.

Usage (mlx-vlm)

uv add mlx-vlm

from mlx_vlm import load, generate
from mlx_vlm.prompt_utils import apply_chat_template

model, processor = load("ToPo-ToPo/Qwythos-9B-Claude-Mythos-5-1M-mlx-4bit-noident")
messages = [{"role": "user", "content": "Hello"}]
prompt = apply_chat_template(processor, model.config, messages)
print(generate(model, processor, prompt, max_tokens=256))

---

This repository is a derivative work distributed under Apache-2.0. The original attribution and license are inherited as noted above.