Downloads · 30 days
39
14% of all-time downloads
morgan/qwen38-27b-mtp-dev20-k4b06-lr1e5-q4-g64-islands
qwen38-27b-mtp-dev20-k4b06-lr1e5-q4-g64-islands is a machine learning model from morgan. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for mlx. The card lists the license as apache-2.0.
This repository contains a proposal-head artifact for native-MTP speculative decoding with Qwen 3.8 27B. It is not a standalone language model: the target backbone and tokenizer are intentionally not included.
Downloads · 30 days
39
14% of all-time downloads
All-time downloads
286
Public
Parameters
82.1M
270 MB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors270 MB · 100%
How the weights are stored.
U3253.1M · 65%
From the Hugging Face model README
This repository contains a proposal-head artifact for native-MTP speculative decoding with Qwen 3.8 27B. It is not a standalone language model: the target backbone and tokenizer are intentionally not included.
The head began with the K=4, acceptance-loss weight β=0.6, learning-rate
1e-5 Dev20 fine-tuning arm. Its eight matrix weights were converted with MLX
0.32.0 affine 4-bit/group-64 quantization; seven one-dimensional normalization
weights remain BF16. The resulting 31-tensor packed head is extended with six
proposal-only precision-island tensors:
precision_islands.q.weight: BF16 [1024, 5120]precision_islands.q.indices: I32 [1024]precision_islands.k.weight: BF16 [1024, 5120]precision_islands.k.indices: I32 [1024]precision_islands.v.weight: BF16 [1024, 5120]precision_islands.v.indices: I32 [1024]For this causal composition, the island index arrays are copied exactly from
the promoted public QKV-islands mechanism at
amal-david/qwen38-mtp-head-q4-qkv-islands-v1@8081fee431e304076b6f6296d6eb5dc7a3fc91af.
All K and V rows are retained, along with its 1,024 selected Q rows. The BF16
island weights are exact row gathers from this fine-tuned head. No selector was
recomputed.
The compatible challenge runtime installs these rows only on the MTP proposal attention projection. The fixed target model still verifies every emitted token. The artifact does not contain executable remote code.
| Field | Value |
|---|---|
model.safetensors bytes | 270404736 |
| Raw file SHA-256 | a6f2640ba96f99ef18b7e4fadd80bca432d93a2dfc3b331c6dc3fe98277eced8 |
| Model-only tree SHA-256 | 5cbc55373ad5bc3339d9143e2cc0216c57ba29206d9e93a10d6e464feac84765 |
| Tensor count | 37 |
| Fine-tuned BF16 source SHA-256 | 0a94bbb07f134c6347a788775087f47e19dbc6cc6bc35b5b8cd5a82adc4b05ca |
| Packed Q4/G64 base SHA-256 | a6df85360b805b747a60c1a51c6784cf624d374f1fed63b2c272a7a0bdc2cf9f |
The model-only tree digest is SHA-256 over this exact line:
a6f2640ba96f99ef18b7e4fadd80bca432d93a2dfc3b331c6dc3fe98277eced8 model.safetensors
517bb133d7ca6e228a5129710b3cb2c25aa9944753b9f9a225fa1e8135df5e65.See provenance.json for the machine-readable record.