negentropy-9b-GGUF

🌀 Negentropy-claude-opus-4.7-9B — GGUF

GGUF quantizations of Jackrong/Negentropy-claude-opus-4.7-9B for local inference with llama.cpp, Ollama, LM Studio, and compatible runtimes.

📦 Available Quantizations

🚀 Usage (llama.cpp)

# Q8_0
llama-cli -hf jrutherford12/negentropy-9b-GGUF:Q8_0 -p "Explain trace inversion." 

# or download + run local
llama-cli -m negentropy-9b-Q8_0.gguf -cnv

Native CoT: model uses <think>...</think> tags for reasoning.

---

💡 About the Model

Based on current public information, commercial models like OpenAI's GPT series and Anthropic's Claude series have clearly hidden their true internal reasoning chains. What we ultimately see through APIs or frontend interfaces are often just "Reasoning Bubbles"—highly compressed and summarized versions of the original massive reasoning content.

Negentropy-claude-opus-4.7-9B is a 9B-level reasoning-enhanced model built on Qwen3.5-9B, fine-tuned with "Trace Inversion": using the Trace-Inverter-4B model to restore compressed "Reasoning Bubbles" leaked by Claude-Opus-4.7 into full Chains-of-Thought, then using those reconstructed traces as supervisory signals.

Best suited for

• 🧠 Advanced logical deduction requiring larger internal state and planning
• 🏗 Reasoning teacher model — generating high-quality CoT data for smaller models
• 🖥 Workstation inference — "Pro-level" thinking on RTX 3090/4090/5090
• 🎓 Academic research into reasoning-recovery scaling laws

Pipeline

1. Trace Capture — sourced from high-fidelity synthetic reasoning datasets
2. Trace Inversion — Jackrong/Trace-Inverter-4B bridges logical gaps in Claude-Opus summaries
3. SFT — Unsloth fine-tune of Qwen3.5-9B on reconstructed reasoning chains

⚠️ Limitations

• Inference latency: lower tokens/sec than the 4B variant (still faster than commercial APIs)
• Hardware: 8–12 GB VRAM for comfortable inference (quant-dependent)
• Hallucination: "logic-style hallucinations" possible — perfect format, wrong facts

---

🙏 Acknowledgements & Citation

Original model, training, and theory by Jackrong. GGUF conversion only.

@misc{jackrong_negentropy_47_9b,
  title        = {Negentropy-claude-opus-4.7-9B: Advanced Reasoning via Trace Inversion},
  author       = {Jackrong},
  year         = {2026},
  publisher    = {Hugging Face}
}

Full model card, methodology, and examples: Jackrong/Negentropy-claude-opus-4.7-9B