Downloads · 30 days
75
10% of all-time downloads
Qwen3-Next-REAP-60B-A3B-Instruct-GGUF
lovedheart/Qwen3-Next-REAP-60B-A3B-Instruct-GGUF
Qwen3-Next-REAP-60B-A3B-Instruct-GGUF is a machine learning model from lovedheart. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Qwen3-Next-REAP-60B-A3B-Instruct has the following specifications:
All-time downloads
723
Public
Repo size
66 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.gguf66 GB · 100%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Jan 8, 2026
- Updated
- Jan 8, 2026
- SHA
- 83c90b6b
Base models
Model card
From the Hugging Face model README
Qwen3-Next-REAP-60B-A3B-Instruct has the following specifications:
- Type: Causal Language Models
- Number of Parameters: 60B in total and 3B activated
- Hidden Dimension: 2048
- Number of Layers: 48
- Hybrid Layout: 12 * (3 * (Gated DeltaNet -> MoE) -> 1 * (Gated Attention -> MoE))
- Gated Attention:
- Number of Attention Heads: 16 for Q and 2 for KV
- Head Dimension: 256
- Rotary Position Embedding Dimension: 64
- Gated DeltaNet:
**Number of Linear Attention Heads: 32 for V and 16 for QK
**Head Dimension: 128 - Mixture of Experts:
- **Number of Experts: 384 (uniformly pruned from 512)
- **Number of Activated Experts: 10
- **Number of Shared Experts: 1
- Context Length: 262,144 natively and extensible up to 1,010,000 tokens
- Compression Method: REAP (Router-weighted Expert Activation Pruning)
- Compression Ratio: 25% expert pruning
- License
- apache-2.0
- Created
- Jan 8, 2026
- Updated
- Jan 8, 2026