Downloads · 30 days
33
2% of all-time downloads
Qwen3-Coder-Next-REAP-40B-A3B
lovedheart/Qwen3-Coder-Next-REAP-40B-A3B
Qwen3-Coder-Next-REAP-40B-A3B is a machine learning model from lovedheart. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
All-time downloads
1.7K
Public
Parameters
41B
82 GB on disk
Likes
9
Public
Repo makeup
Click a slice to open those files.
.safetensors82 GB · 100%
At a glance
- License
- apache-2.0
- Model type
- qwen3_next
- Access
- Public
- Created
- Feb 5, 2026
- Updated
- Feb 5, 2026
- SHA
- 7982223b
Base models
Model card
From the Hugging Face model README
Qwen3-Coder-Next-REAP-40B-A3B has the following specifications:
- Type: Causal Language Models
- Number of Parameters: 40B in total and 3B activated
- Hidden Dimension: 2048
- Number of Layers: 48
- Hybrid Layout: 12 * (3 * (Gated DeltaNet -> MoE) -> 1 * (Gated Attention -> MoE))
- Gated Attention:
- Number of Attention Heads: 16 for Q and 2 for KV
- Head Dimension: 256
- Rotary Position Embedding Dimension: 64
- Gated DeltaNet:
**Number of Linear Attention Heads: 32 for V and 16 for QK
**Head Dimension: 128 - Mixture of Experts:
- **Number of Experts: 256 (uniformly pruned from 512)
- **Number of Activated Experts: 10
- **Number of Shared Experts: 1
- Context Length: 262,144 natively
- Compression Method: REAP (Router-weighted Expert Activation Pruning)
- Compression Ratio: 50% expert pruning
- Type
- qwen3_next
- License
- apache-2.0
- Created
- Feb 5, 2026
- Updated
- Feb 5, 2026