Downloads · 30 days
669
5% of all-time downloads
Qwen3-Coder-Next-REAP-40B-A3B-GGUF
lovedheart/Qwen3-Coder-Next-REAP-40B-A3B-GGUF
Qwen3-Coder-Next-REAP-40B-A3B-GGUF is a machine learning model from lovedheart. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
All-time downloads
13.6K
Public
Repo size
270 GB
Likes
26
Public
Repo makeup
Click a slice to open those files.
.gguf270 GB · 100%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Feb 4, 2026
- Updated
- Feb 5, 2026
- SHA
- 3a109ada
Base models
Model card
From the Hugging Face model README
Qwen3-Coder-Next-REAP-40B-A3B has the following specifications:
- Type: Causal Language Models
- Number of Parameters: 40B in total and 3B activated
- Hidden Dimension: 2048
- Number of Layers: 48
- Hybrid Layout: 12 * (3 * (Gated DeltaNet -> MoE) -> 1 * (Gated Attention -> MoE))
- Gated Attention:
- Number of Attention Heads: 16 for Q and 2 for KV
- Head Dimension: 256
- Rotary Position Embedding Dimension: 64
- Gated DeltaNet:
**Number of Linear Attention Heads: 32 for V and 16 for QK
**Head Dimension: 128 - Mixture of Experts:
- **Number of Experts: 256 (uniformly pruned from 512)
- **Number of Activated Experts: 10
- **Number of Shared Experts: 1
- Context Length: 262,144 natively
- Compression Method: REAP (Router-weighted Expert Activation Pruning)
- Compression Ratio: 50% expert pruning
Test video (writing tiny video game @ Q4_K_XL ): https://bilibili.com/video/BV1k6fZB7EQz/
- License
- apache-2.0
- Created
- Feb 4, 2026
- Updated
- Feb 5, 2026