Qwen3.8-27B-MTPLX-Q4

Qwen3.8-27B-MTPLX-Q4

MTPLX-compatible 4-bit conversion of [Qwen/Qwen3.8-27B], built locally from the original BF16 checkpoint while preserving the model's native MTP weights in BF16.

Quantization

• Base model: Qwen/Qwen3.8-27B
• Body: 4-bit affine
• Group size: 64
• MTP sidecar: native BF16
• Maximum verified MTP depth: 3
• MTPLX version: 2.3.0
• Source format: BF16 native MTP

Forge recipe:

{
  "body_bits": 4,
  "body_dtype": "auto",
  "body_group_size": 64,
  "body_mode": "affine",
  "mtp_policy": "keep_bf16"
}

Verification Results

Verified locally with MTPLX Forge using the long-code-uncapped suite with a maximum generation budget of 2048 tokens.

Forge verdict:

mtp_depth_wins

All tested depths passed the Forge quality verification gate.

The recommended profile produced by Forge is:

sustained

MTP Configuration

architecture: qwen3-next-mtp
mtp_depth_max: 3
mtp_sidecar: bf16
base_hidden_variant: post_norm
hidden_variant: post_norm
concat_order: embedding_hidden
mtp_position_mode: local

Source Provenance

• Source repository: Qwen/Qwen3.8-27B
• Source commit: 1d4bf0f2ff6012fd82039f2fa52739d0dd7c60c0
• Conversion: MTPLX Forge
• MTPLX version: 2.3.0
• Forged locally on macOS / Apple Silicon

The MTP weights were preserved from the original BF16 checkpoint rather than requantized.

Performance Notes

The benchmark numbers above are specific to the machine used for verification and should not be treated as universal throughput figures.

The more useful result is the relative improvement on the same hardware:

15.74 tok/s AR
        ↓
44.34 tok/s MTP depth 3

2.82× decode throughput

MTP acceptance remained high through depth 3, with the third speculative position accepted approximately 81.7% of the time.

Usage

This model is intended for use with MTPLX on Apple Silicon.

After downloading, inspect the included runtime metadata and use the MTPLX runtime to load the model. The Forge-generated runtime metadata contains the verified MTP contract and recommended configuration.

License

This conversion follows the Apache-2.0 license of the original Qwen/Qwen3.8-27B checkpoint.

See the upstream model repository for additional usage information and attribution requirements.