Ling-3.0-flash-ROCmFP4-STRIX_LEAN-GGUF

Ling-3.0-flash — ROCmFP4 STRIX_LEAN (ftype 106)

This is the one you want if you just want to run Ling-3.0-flash on a Strix Halo box.

I quantized inclusionAI/Ling-3.0-flash (instruct) to ftype 106 Q4_0_ROCMFP4_STRIX_LEAN for AMD gfx1151 — Ryzen AI MAX+ 395, 128 GB unified memory. It's my standard serving build: 4-bit body, lean Q5_K token embeddings, and a protected Q6_K LM head.

⚠️ You need a ROCmFPX-capable llama.cpp build. These tensor types (Q4_0_ROCMFP4_*, Q*_0_ROCMFPX*) are not in mainline, so this will not load in stock llama.cpp, Ollama, or LM Studio.

What kind of build this is

I publish three Ling-3.0-flash builds and they are not interchangeable:

All three come from the same aligned checkpoint. The word "Research" in the other two refers to how I quantized them, not to a different or de-aligned model.

Why the head matters here

tie_word_embeddings = false on this model, so output.weight is a real standalone tensor and --output-tensor-type does actual work. My earlier 4-bit instruct builds left output.weight at 4-bit — that is a real quality defect, not a rounding detail. This build forces the LM head to Q6_K, and I verify it by exact tensor name (output.weight, never a substring — it matches inside attn_output.weight):

⚠️ ftype 106 does not protect the head on its own. If you build this yourself and skip the flag, you get a 4-bit head and a worse model that looks identical from the outside.

Receipts

Source: inclusionAI/Ling-3.0-flash @ 42766a814ab117e75e2e61465d5e131b72d931a3, converted to a 255,091,083,232-byte BF16 GGUF (938 tensors), then quantized.

llama-quantize --output-tensor-type q6_K \
  Ling-3.0-flash-I-BF16.gguf \
  Ling-3.0-flash-I-ROCmFP4-STRIX_LEAN.gguf \
  Q4_0_ROCMFP4_STRIX_LEAN 16

Converter note

Upstream emits the KDA gate tensors as blk.N.ssm_f_a / ssm_g_a (vestigial kimi-linear names); the runtime I use wants blk.N.ssm_f / ssm_g. Same shapes, same semantics — a naming dialect. I patched the converter and verified the result: 35× ssm_f + 35× ssm_g, zero _a leftovers (42 layers − 7 full-attention = 35 KDA layers).

Measured on my own hardware. Every number above is read back from the built file.