QwenPaw-Flash-9B-heretic

<div style="background: #f5f5f7; border-radius: 20px; padding: 36px 32px; margin-bottom: 24px; text-align: center; position: relative; overflow: hidden; font-family: -apple-system, BlinkMacSystemFont, 'Segoe UI', Roboto, sans-serif;"> <div style="position: absolute; top: -30px; right: -30px; width: 120px; height: 120px; background: #ffedd5; border-radius: 50%;"></div> <div style="position: absolute; bottom: -20px; left: 40px; width: 80px; height: 80px; background: #fed7aa; border-radius: 50%;"></div> <div style="position: absolute; top: 50%; left: -15px; width: 60px; height: 60px; background: #ffedd5; border-radius: 50%;"></div> <div style="display: inline-flex; gap: 8px; margin-bottom: 16px; position: relative; z-index: 1;"> <span style="background: #007aff; color: white; font-size: 11px; font-weight: 600; padding: 5px 14px; border-radius: 20px;">GGUF</span> <span style="background: #af52de; color: white; font-size: 11px; font-weight: 600; padding: 5px 14px; border-radius: 20px;">Heretic</span> </div> <h1 style="margin: 0 0 8px 0; font-size: 32px; font-weight: 700; color: #1d1d1f; letter-spacing: -0.5px; border: none; position: relative; z-index: 1;">QwenPaw-Flash-9B-heretic</h1> <p style="margin: 8px 0 0 0; font-size: 14px; position: relative; z-index: 1;"><span style="color: #86868b;">English</span> | <a href="https://huggingface.co/SC117/QwenPaw-Flash-9B-heretic/blob/main/README_zh.md" style="color: #007aff; text-decoration: none;">📖 中文文档</a></p> </div> <div style="border: 1px solid #cbd5e1; border-radius: 12px; overflow: hidden; background: #ffffff; box-shadow: 0 2px 4px rgba(0,0,0,0.02); margin-bottom: 20px;"> <div style="background: linear-gradient(135deg, #ff6b35 0%, #f7931e 100%); padding: 12px 16px; color: white; font-weight: 700; font-size: 14px; display: flex; align-items: center; gap: 8px;"><span>📌</span> Overview</div> <div style="padding: 16px; font-size: 13px; color: #334155; line-height: 1.7;"> F32 safetensors of **QwenPaw-Flash-9B-heretic**, a 9B dense model fine-tuned with Heretic methodology on Qwen3.5-9B. </div> </div> <div style="border: 1px solid #cbd5e1; border-radius: 12px; overflow: hidden; background: #ffffff; box-shadow: 0 2px 4px rgba(0,0,0,0.02); margin-bottom: 20px;"> <div style="background: linear-gradient(135deg, #ff6b35 0%, #f7931e 100%); padding: 12px 16px; color: white; font-weight: 700; font-size: 14px; display: flex; align-items: center; gap: 8px;"><span>🧠</span> Model Details</div> <div style="padding: 16px; font-size: 13px; color: #334155; line-height: 1.7;"> - **Base model**: Qwen3.5-9B - **Precision**: F32 (float32 safetensors) - **Parameters**: ~9B - **Shards**: model-00001 ~ model-00008 (8 files, F32 main weights) - **Additional**: model-00009 (BF16, Multi-Token Prediction head extracted from Qwen3.5-9B) </div> </div> <div style="border: 1px solid #cbd5e1; border-radius: 12px; overflow: hidden; background: #ffffff; box-shadow: 0 2px 4px rgba(0,0,0,0.02); margin-bottom: 20px;"> <div style="background: linear-gradient(135deg, #ff6b35 0%, #f7931e 100%); padding: 12px 16px; color: white; font-weight: 700; font-size: 14px; display: flex; align-items: center; gap: 8px;"><span>⚡</span> MTP (Multi-Token Prediction)</div> <div style="padding: 16px; font-size: 13px; color: #334155; line-height: 1.7;"> `model-00009-of-00009.safetensors` contains the MTP head weights extracted from Qwen3.5-9B. MTP enables the model to predict multiple future tokens in a single forward pass, improving generation speed via speculative decoding.

• MTP acceptance rate: ~43%
• Speedup: ~1.5-1.9x decode throughput

For MTP-enabled GGUF inference, see the MTP GGUF repo below.

</div> </div> <div style="border: 1px solid #cbd5e1; border-radius: 12px; overflow: hidden; background: #ffffff; box-shadow: 0 2px 4px rgba(0,0,0,0.02); margin-bottom: 20px;"> <div style="background: linear-gradient(135deg, #ff6b35 0%, #f7931e 100%); padding: 12px 16px; color: white; font-weight: 700; font-size: 14px; display: flex; align-items: center; gap: 8px;"><span>📦</span> GGUF Quantized Versions</div> <div style="padding: 16px; font-size: 13px; color: #334155; line-height: 1.7;"> For inference with llama.cpp / Ollama / LM Studio, use the GGUF versions:

• Standard GGUF (no MTP): SC117/QwenPaw-Flash-9B-heretic-GGUF
• MTP GGUF (with Multi-Token Prediction head): SC117/QwenPaw-Flash-9B-heretic-MTP-GGUF

</div> </div> <div style="border: 1px solid #cbd5e1; border-radius: 12px; overflow: hidden; background: #ffffff; box-shadow: 0 2px 4px rgba(0,0,0,0.02); margin-bottom: 20px;"> <div style="background: linear-gradient(135deg, #ff6b35 0%, #f7931e 100%); padding: 12px 16px; color: white; font-weight: 700; font-size: 14px; display: flex; align-items: center; gap: 8px;"><span>🚀</span> Usage</div> <div style="padding: 16px; font-size: 13px; color: #334155; line-height: 1.7;"> ```python from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained( "SC117/QwenPaw-Flash-9B-heretic", torch_dtype=torch.float32, device_map="auto", ) tokenizer = AutoTokenizer.from_pretrained("SC117/QwenPaw-Flash-9B-heretic")

</div>
</div>
<div style="border: 1px solid #cbd5e1; border-radius: 12px; overflow: hidden; background: #ffffff; box-shadow: 0 2px 4px rgba(0,0,0,0.02); margin-bottom: 20px;">
<div style="background: linear-gradient(135deg, #ff6b35 0%, #f7931e 100%); padding: 12px 16px; color: white; font-weight: 700; font-size: 14px; display: flex; align-items: center; gap: 8px;"><span>📄</span> License</div>
<div style="padding: 16px; font-size: 13px; color: #334155; line-height: 1.7;">
Same as base model (Qwen3.5-9B).
</div>
</div>

<!-- SC117_SUPPORT_START -->
<div align="center">
  <a href="https://ko-fi.com/sc117">
    <img
      src="https://huggingface.co/SC117/Qwen3.8-Flash-Next-GSQ-RCO-abliterated-GGUF/resolve/main/assets/support-sc117.png"
      alt="Support SC117 on Ko-fi — support is optional and all releases remain freely available."
      width="100%"
    />
  </a>
</div>
<!-- SC117_SUPPORT_END -->