Downloads · 30 days
26
27% of all-time downloads
weili-0234/Qwen3.5-27B-MXFP4-QAD-W4A16-LR1e-5-s2640
Qwen3.5-27B-MXFP4-QAD-W4A16-LR1e-5-s2640 is a machine learning model from weili-0234. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
MXFP4 vLLM-schema export of the MX-W4A16 QAD arm final checkpoint (weight-only fake-quant training) from the stage-3 W4A4-vs-W4A16 training study on dense Qwen/Qwen3.5-27B. Activation quantization is applied dynamical…
Downloads · 30 days
26
27% of all-time downloads
All-time downloads
96
Public
Parameters
15.9B
19 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors18.9 GB · 100%
How the weights are stored.
U812.9B · 81%
From the Hugging Face model README
MXFP4 vLLM-schema export of the MX-W4A16 QAD arm final checkpoint (weight-only fake-quant training) from the stage-3 W4A4-vs-W4A16 training study on dense Qwen/Qwen3.5-27B. Activation quantization is applied dynamically by vLLM at serving time, so this single artifact serves both W4A4 and W4A16 modes.
8e7cf1a + save fix + the 2026-07-24 context patches.configs/llm/qwen3_5_27b_mxfp4_qad.yaml (W4A16 training), lr 1.0e-5 cosine
(1% warmup), 2640 steps (~1 epoch), global batch 32, seq 8192, seed 42,
BF16 FSDP2, save/250, eval/100.0406bb3a7a482352360716a1bc5e9e04; disjoint eval split).Final held-out eval fwd-KL 0.008904 vs the BF16 teacher (own W4A16 training quant config; plateau ~0.0089 from step 1300). The matched MX-W4A4-trained twin reached 0.0316 in its own (harder) W4A4 config — the decisive cross-comparison (both finals served at real W4A4) is being produced by the standardized 7-benchmark campaign and will be added here.
python scripts/export_mxfp4_vllm.py \
--source /scratch/wxu/mxfp4/outputs/27b-mxfp4-w4a16-lr1.0e-5-2640 \
--model-assets /scratch/wxu/mxfp4/models/Qwen3.5-27B \
--output /scratch/wxu/mxfp4/exports/27b-mxw4a16-s2640 --device cuda:0
Load-smoked with vLLM 0.25.1: loads clean, completes text correctly.