Downloads · 30 days
0
qwen3-5-4b-base-mtp
FoxlightAI/qwen3-5-4b-base-mtp
qwen3-5-4b-base-mtp is a machine learning model from FoxlightAI. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
This repository contains an MTP speculative-decoding sidecar derived from Qwen/Qwen3.5-4B-Base. It is not a standalone model — it provides the multi-token-prediction heads used by Skulk to speculatively decode for the…
Access
Public
Updated Jun 2, 2026
Repo size
241 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors241 MB · 100%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Jun 2, 2026
- Updated
- Jun 2, 2026
- SHA
- f78c8dc3
Base models
Model card
From the Hugging Face model README
FoxlightAI/qwen3-5-4b-base-mtp
This repository contains an MTP speculative-decoding sidecar derived from Qwen/Qwen3.5-4B-Base. It is not a standalone model — it provides the multi-token-prediction heads used by Skulk to speculatively decode for the target model Qwen/Qwen3.5-4B-Base. The heads ship at full precision (bf16, unquantized) — they are the speculative drafter, where precision drives draft acceptance — so there is one sidecar per base model and it serves every quantization of the target.
Provenance
| Field | Value |
|---|---|
| Artifact type | mtp-sidecar |
| Source model | Qwen/Qwen3.5-4B-Base |
| Source revision | 1001bb4d826a52d1f399e183466143f4da7b741b |
| Target model | Qwen/Qwen3.5-4B-Base |
| Extracted with | skulk-weights-publisher 0.1.0 |
| Generated | 2026-06-02T23:18:58Z |
Usage
Skulk loads this sidecar (mtp.safetensors) alongside the target model to enable MTP speculative decoding. It is referenced from the Skulk Weights Publisher catalog and fetched automatically by the Skulk shard downloader; it is not intended to be loaded standalone.
License
This artifact is derived from Qwen/Qwen3.5-4B-Base and is published under that model's original license (apache-2.0), preserved unchanged. Refer to the source model's card for the full terms.
- License
- apache-2.0
- Created
- Jun 2, 2026
- Updated
- Jun 2, 2026