Ornith-9B-MLX-5bit

<center> <div style="display:flex; justify-content:center; align-items:center; gap:2%; max-width:560px; margin:0 auto;"> <a href="https://atomic.chat" style="flex:0 1 auto; min-width:0;"><img src="https://huggingface.co/AtomicChat/ornith-9b-MLX-5bit/resolve/main/pill_atomic_v3.png" alt="Atomic Chat" style="width:100%; height:auto; max-width:186px;"></a> <a href="https://discord.gg/8wGSsvmg4V" style="flex:0 1 auto; min-width:0;"><img src="https://huggingface.co/AtomicChat/ornith-9b-MLX-5bit/resolve/main/pill_discord_v3.png" alt="Join Discord" style="width:100%; height:auto; max-width:184px;"></a> <a href="https://github.com/AtomicBot-ai/Atomic-Chat" style="flex:0 1 auto; min-width:0;"><img src="https://huggingface.co/AtomicChat/ornith-9b-MLX-5bit/resolve/main/pill_github_v3.png" alt="GitHub" style="width:100%; height:auto; max-width:141px;"></a> </div> <br/> <img src="https://huggingface.co/AtomicChat/ornith-9b-MLX-5bit/resolve/main/hero.png" alt="Ornith 1.0 9B" style="width:100%; max-width:100%; height:auto; margin-bottom:0.6em;"/> <div style="display:flex; justify-content:center; gap:0.5em;"> <a href="https://huggingface.co/deepreinforce-ai/Ornith-1.0-9B"><strong>Base model: deepreinforce-ai/Ornith-1.0-9B</strong></a> </div> </center>

Ornith 1.0 9B, self-quantized to MLX by Atomic Chat. Built straight from DeepReinforce's original weights with a per-tensor importance matrix, so this is not a repack of somebody else's files. Runs fully offline.

Highlights

• 0.0B parameters: the weights this repo quantizes.
• Context length: 262,144 tokens (256K), as published by DeepReinforce.
• 32 layers: Dense decoder.
• Modalities: Text, Image.
• Full imatrix ladder: every quant is calibrated with an importance matrix.
• State-of-the-Art Coding Agents: Available in 9B-Dense, 31B-Dense, 35B-MoE, and 397B-MoE (post-trained on top of Gemma 4 and Qwen 3.5), achieving state-of-the-art performance among open-source models of comparable size on coding benchmarks such as Terminal-Bench 2.1, SWE-Bench, NL2Repo and OpenClaw.
• Self-Improving Training Framework: Ornith-1.0 employs RL to learn to generate not only solution rollouts, but also the scallfold that drive those rollouts. By jointly optimizing the scaffold and the resulting solution, the model discovers better search trajectories and generates higher-quality solutions.

[!NOTE] These MLXs are self-quantized from the original weights, not a repack. The importance matrix keeps low-bit quants closer to the full-precision model.

Model Overview

Get started

• Atomic Chat: search AtomicChat/ornith-9b-MLX-5bit and hit Use this model.
• mlx-lm: mlx_lm.generate --model AtomicChat/ornith-9b-MLX-5bit --prompt "Hello" --max-tokens 512
• Server: mlx_lm.server --model AtomicChat/ornith-9b-MLX-5bit --port 8080

Best practices

DeepReinforce's recommended sampling configuration for deepreinforce-ai/Ornith-1.0-9B.

How these were made

1. Download deepreinforce-ai/Ornith-1.0-9B (original weights).
2. Convert and quantize with mlx_lm.convert on our pipeline.

License

Original model by DeepReinforce, released under the MIT license. Full terms: MIT. Quantized by Atomic Chat.