Qwen3.5-4B-MXFP4

Rapid42/Qwen3.5-4B-MXFP4

Qwen3.5 4B — quantized to MXFP4 for Apple Silicon

Converted and optimized by Rapid42 — engineering tools for fast pipelines.

---

What This Is

This is Qwen3.5-4B quantized to MXFP4 format using mlx-lm. Blazing fast on any M-series Mac — even the base M1/M2 with 8GB RAM.

The smallest model in our Qwen3.5 lineup. Best for:

• Rapid iteration — fast drafts, autocomplete, short-form generation

• Always-on assistants — runs alongside other apps without memory pressure

• Edge/embedded — lowest resource footprint in the family

• Parameters: ~4B (dense)

• Quantization: MXFP4 (via mlx-lm 0.31.1)

• Base model: Qwen/Qwen3.5-4B

• Framework: Apple MLX

---

Hardware Requirements

This is the "works on everything" model. Load time under 5 seconds on any M-series chip.

---

Quick Start

pip install mlx-lm

from mlx_lm import load, generate

model, tokenizer = load("Rapid42/Qwen3.5-4B-MXFP4")

messages = [{"role": "user", "content": "Write a bash script to batch rename EXR files."}]
prompt = tokenizer.apply_chat_template(
    messages, add_generation_prompt=True, return_dict=False
)

response = generate(model, tokenizer, prompt=prompt, max_tokens=256, verbose=True)
print(response)

CLI (instant interactive chat):

mlx_lm.chat --model Rapid42/Qwen3.5-4B-MXFP4

---

When to Use 4B vs Larger Models

---

Why MXFP4?

MXFP4 (Microscaling FP4) uses per-block scaling factors that preserve more precision than standard int4, while remaining natively fast on Apple Silicon via MLX. For a 4B model this means near-fp16 quality at int4 memory cost.

---

About Rapid42

Rapid42 builds fast, precise engineering tools — from VFX pipeline utilities to optimized ML model distributions.

→ rapid42.com · ExrToPsd · Level Careers