Downloads · 30 days
94
23% of all-time downloads
YOYO-AI/Qwen3-30B-A3B-YOYO-Thinking-Chimera
Qwen3-30B-A3B-YOYO-Thinking-Chimera is a text generation model from YOYO-AI. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
We successfully replicated the model stitching effect of DeepSeek-R1T-Chimera in the Qwen3-30B-A3B series.
Downloads · 30 days
94
23% of all-time downloads
All-time downloads
409
Public
Parameters
30.5B
61.1 GB on disk
Likes
7
Public
Click a slice to open those files.
.safetensors61.1 GB · 100%
From the Hugging Face model README
We successfully replicated the model stitching effect of DeepSeek-R1T-Chimera in the Qwen3-30B-A3B series.
merge method: model stitching
Highest precision: bfloat16
Context length: 262,144&1010000
[!NOTE]
Temperature=0.6,TopP=0.95,TopK=20,MinP=0.
Due to differences in model architecture and parameter scale, we discovered that when replicating the paper's results using the Qwen3-30B-A3B series, simply replacing the routing expert tensors of the instruction model with those of the thinking model failed to generate complete reasoning labels.
Therefore, we replaced both the routing expert tensors and the attention tensors with those from the thinking model, while keeping all other tensor components entirely from the instruction model.
We hope this insight proves valuable to others!