Downloads · 30 days
16
2% of all-time downloads
EidosL/Qwopus3.6-27B-v2-MTP-Q5_K_M-rys68.gguf
Qwopus3.6-27B-v2-MTP-Q5_K_M-rys68.gguf is a machine learning model from EidosL. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
RYS (Repeat Your Self) Layer-Expanded Qwopus3.6-27B-v2-MTP Boosting reasoning capabilities by duplicating middle layers, no retraining required
Downloads · 30 days
16
2% of all-time downloads
All-time downloads
657
Public
Repo size
20.3 GB
Likes
3
Public
Click a slice to open those files.
.gguf20.3 GB · 100%
From the Hugging Face model README
RYS (Repeat Your Self) Layer-Expanded Qwopus3.6-27B-v2-MTP
Boosting reasoning capabilities by duplicating middle layers, no retraining required
This model is a RYS layer-expanded version of Jackrong/Qwopus3.6-27B-v2-MTP. By duplicating 3 Transformer blocks from the middle layers (blk.32-34), the model is expanded from 65 to 68 layers, enhancing reasoning and mathematical capabilities.
| Property | Value |
|---|---|
| Base Model | Qwopus3.6-27B-v2-MTP |
| Architecture | Qwen3.5 (identical to Qwen3.6) |
| Parameters | ~27B |
| Quantization | Q5_K_M |
| Original Layers | 65 blocks (64 transformer + 1 MTP) |
| RYS-Expanded Layers | 68 blocks (+3 duplicated) |
| MTP Layer Position | blk.67 (shifted from blk.64) |
RYS (Repeat Your Self) is a training-free model enhancement technique discovered by David Noel Ng.
Transformer reasoning capabilities are organized as discrete functional circuits. By duplicating middle layers, the model gains a "second pass" through these circuits, improving reasoning quality.
| Configuration | Extra Layers | Overhead | Math Δ | EQ Δ | Total Δ |
|---|---|---|---|---|---|
(33,34) | +1 | +1.56% | +0.0179 | +0.0945 | +0.1124 |
(31,34) | +3 | +4.69% | +0.0207 | +0.0972 | +0.1179 |
(30,35) | +5 | +7.81% | +0.0279 | +0.0979 | +0.1257 |
(32,34) | +3 | +4.69% | - | - | - |
This model uses the (32,34) configuration, duplicating blk.32, blk.33, and blk.34.
Original Model (65 blocks):
├── blk.0 ~ blk.63 (64 transformer blocks)
└── blk.64 (MTP layer: nextn.*)
RYS-Expanded Model (68 blocks):
├── blk.0 ~ blk.63 (original transformer blocks, unchanged)
├── blk.64 ← duplicated from blk.32
├── blk.65 ← duplicated from blk.33
├── blk.66 ← duplicated from blk.34
└── blk.67 ← shifted from original blk.64 (MTP layer)
| Field | Original | After RYS |
|---|---|---|
qwen35.block_count | 65 | 68 |
tensor_count | 881 | 908 |
| MTP layer name | blk.64.nextn.* | blk.67.nextn.* |
blk.32.ssm_conv1d.weight → blk.64.ssm_conv1d.weight: OK (6adfcc7f9dd525a7)
blk.33.ssm_out.weight → blk.65.ssm_out.weight: OK (019adc1c0a27e316)
blk.34.ssm_beta.weight → blk.66.ssm_beta.weight: OK (71a6c0bb2a430101)
blk.64.nextn.eh_proj.weight → blk.67.nextn.eh_proj.weight: OK (5311ef450f57a71d)
# Load directly, same usage as original GGUF
llama-server -m Qwopus3.6-27B-v2-MTP-Q5_K_M-rys68.gguf \
-c 49152 \
--temp 1.0 \
--top-p 0.95
# Create Modelfile
cat > Modelfile << 'EOF'
FROM ./Qwopus3.6-27B-v2-MTP-Q5_K_M-rys68.gguf
PARAMETER num_ctx 49152
PARAMETER temperature 1.0
PARAMETER top_p 0.95
EOF
# Build and run
ollama create qwopus-rys68 -f Modelfile
ollama run qwopus-rys68
Based on RYS research findings, this model is expected to show improvements in:
| Domain | Expected Improvement |
|---|---|
| Mathematical Reasoning | +2-3% accuracy gain |
| Emotional Intelligence (EQ) | +9-10% improvement |
| Logical Reasoning | Moderate improvement |
| Code Generation | Maintained or slight improvement |
Note: Actual results depend on task type. RYS is most effective for tasks requiring deep reasoning.
If you use this model or the RYS method, please cite the original work:
@article{ng2026rysii,
title = {LLM Neuroanatomy II: Modern LLM Hacking and hints of a Universal Language?},
author = {Ng, David Noel},
year = {2026},
month = {March},
url = {https://dnhkng.github.io/posts/rys-ii/}
}
@misc{qwopus36_27b_v2_mtp_2026,
title = {Qwopus3.6-27B-v2-MTP},
author = {Jack Rong},
year = {2026},
note = {Qwen3.6-27B based Multi-Token Prediction reasoning model},
howpublished = {Hugging Face model card}
}
This model inherits the license of the original Qwopus3.6-27B-v2-MTP. Please refer to the original model page for details.
Model card generated: 2026-05-24