Ling-3.0-flash-ROCmFPX-Q6-AGENT-GGUF

Ling-3.0-flash — Research Q6 AGENT (ftype 114)

This is the high-fidelity end of my research family — 117 GB, 8-bit heads, and the slowest of the three. It is not my serving build. If you just want to run the model, take Ling-3.0-flash-ROCmFP4-STRIX_LEAN-GGUF instead.

⚠️ "Research" here means the QUANT RECIPE, not a modified model

This is the same aligned inclusionAI/Ling-3.0-flash checkpoint as my serving build — same weights, same behavior, same alignment. Not uncensored, not ablated. What makes it "research" is how I quantized it: I follow my own research quant recipe rather than my serving recipe, so I can measure what each precision choice buys.

What kind of build this is

ftype 114 Q6_0_ROCMFPX_AGENT — a 6-bit ROCmFPX body with Q8_0_ROCMFPX (tensor type 103) heads and attention output. The AGENT routing keeps attention-output tensors at higher precision, which is the part that matters most for tool-calling and structured output.

⚠️ Don't confuse tensor type 103 with ftype 103. Tensor type Q8_0_ROCMFPX is 8-bit. Ftype 103 (FAST) is 4-bit. Same number, completely different things.

Where this sits in the family — all three are the same checkpoint, differing only in quantization:

The honest trade: this costs 73 GB more and 4.9 t/s versus my serving build. I keep it as the upper-bound reference — when I want to know whether a 4-bit build lost something real, I compare against this, not against a guess. Unless you specifically need the fidelity ceiling or you're doing heavy tool-calling with memory to spare, the serving build is the better pick.

⚠️ Requires a ROCmFPX-capable llama.cpp build — these tensor types aren't in mainline, so stock llama.cpp / Ollama / LM Studio won't load it. ⚠️ At 117 GB this is tight even on a 128 GB Strix Halo box. Check your headroom before pulling it.

Receipts

Heads read back by exact tensor name — never a substring, since output.weight matches inside attn_output.weight:

I also dry-ran --output-tensor-type q6_K on this tier and rejected it: it would have demoted the head from 8-bit to 6-bit. The native Q8 heads are already better than the override, so I left them alone.

Source: inclusionAI/Ling-3.0-flash @ 42766a814ab117e75e2e61465d5e131b72d931a3 → 255,091,083,232-byte BF16 GGUF (938 tensors) → quantized.

llama-quantize \
  Ling-3.0-flash-I-BF16.gguf \
  Ling-3.0-flash-I-Research-Q6_0_ROCMFPX_AGENT.gguf \
  Q6_0_ROCMFPX_AGENT 16

Measured on my own hardware (gfx1151, Strix Halo). Every number is read back from the built file.