Motif-3-GGUF

Motif 3 — Q8_0 GGUF

Support my work

I work on making large language models practical on hardware they were never really designed to fit on — through mixed quantization, inference optimization, custom kernels, and serving experiments.

While much of the development happens on local hardware, calibration, profiling, and large-scale validation often require expensive on-demand GPUs.

Contributions help pay for that compute, storage, and testing infrastructure, so I can keep experimenting and publishing the results openly.

<a href="https://www.buymeacoffee.com/baekpica" target="_blank"><img src="https://cdn.buymeacoffee.com/buttons/v2/default-yellow.png" alt="Buy Me a Coffee" style="height: 60px !important;width: 217px !important;"></a> <a href="https://github.com/sponsors/Baekpica" target="_blank"><img src="https://img.shields.io/badge/Sponsor-EA4AAA?style=for-the-badge&logo=githubsponsors&logoColor=white" alt="Sponsor Baekpica on GitHub" style="height: 60px !important;width: 217px !important;"></a>

Full-topology Q8_0 reference conversion of Motif-Technologies/Motif-3. This is an independent conversion, not an official Motif Technologies release.

The conversion retains all 53 transformer layers, including the first two dense layers and all 51 sparse layers; all 384 routed experts per sparse layer (top-8 routing); the shared expert; Grouped Differential Latent Attention (GDLA); Expert-Specific PolyNorm; modified mHC; and the one-layer MTP head. Nothing is pruned, merged, expert-dropped, or layer-dropped.

Artifact

Start with Motif-3-Q8_0-00001-of-00011.gguf; split-aware runtimes discover the remaining shards automatically. Exact hashes are in Q8_0-SHA256SUMS.

The weight files are fixed at Hub revision 5c266c95bf8c8d822d50e5e1cce9d108eaadb2af. Later model-card commits do not change shard bytes or hashes.

hf download Baekpica/Motif-3-GGUF \
  --revision 5c266c95bf8c8d822d50e5e1cce9d108eaadb2af \
  --include 'Motif-3-Q8_0-*.gguf' \
  --include Q8_0-SHA256SUMS \
  --local-dir ./Motif-3-Q8_0

This reference follows the control-path protection policy used by the mixed release. Its 2,287 GGUF tensors comprise:

The protected BF16/F32 tensors are intentional. “Q8_0 reference” means every large quantizable weight matrix, including every routed expert matrix, is Q8_0; decision-sensitive controls remain at their locked higher precision.

Provenance

Only the official final Motif-3 checkpoint above was used. Motif-3-Beta was not used as a source, calibration input, implementation oracle, or fallback.

Validation status

The completed 11-shard artifact passed a strict source-map verification:

• all 2,287 expected GGUF tensors are present exactly once;
• every shape, type, byte length, and split index/count matches the locked map;
• all 53 layers are present, including routed gate/up/down tensors for sparse layers 2–52 and the full MTP block;
• general.source.revision is the pinned official revision above;
• the aggregate verified tensor payload is 334,801,074,712 bytes;
• no structural-template marker remains in the release files.

A separate source-row sanity pass dequantized 57 representative rows spanning the embedding, LM head, GDLA, dense/shared paths, routed gate/up/down matrices at sparse layers 2/26/52, protected controls, and MTP. It also samples both halves of the fused source gate/up tensors across experts 0/173/383. F32 and BF16 protected rows were source-exact; Q8_0 cosine was at least 0.9999740124, with maximum sampled relative RMSE 0.007201264.

The machine-readable report and complete per-shard SHA-256 list are included as Q8_0-VERIFY.json, Q8_0-SAMPLE-VERIFY.json, and Q8_0-SHA256SUMS.

The 262,144-token value is source architecture metadata. This Q8 repository does not by itself claim completed single-DGX-Spark 256K serving. That release gate belongs to the native motif3 ds4 runtime and requires measured resident weights, latent KV, workspace/server memory, prefill, decode, and semantic checks on GB10.

Runtime compatibility

Motif 3 is not a Llama-family graph. A runtime must implement its 384E sigmoid router and route normalization, shared expert, Expert-Specific PolyNorm, GDLA/differential heads and output gate, modified mHC, interleaved SWA/full attention with YaRN, latent KV semantics, and MTP. Do not assume that a stock GGUF runtime recognizes motif3 merely because it can parse the container.

The H200 development branch is publicly available as Baekpica/ds4:feature/motif-3-model-loader at exact implementation commit d878ea1a1d67bc0f0bd60e20e75b4a011aa2d8d9. The private Spark handoff also preserves an offline source snapshot and commit metadata.

Intended use in the mixed-quant pipeline

This artifact is produced first and frozen as the full-model Q8_0 reference. The next stage collects an activation importance matrix from the pinned calibration corpus, after which routed gate/up weights are quantized to IQ2_XXS with that imatrix and routed down weights to Q2_K. The resulting MQ87–88 artifact is published separately at Baekpica/Motif-3-Mixed-Quant-GGUF.

License and attribution

The source model identifies its license as MIT. See the official Motif-Technologies/Motif-3 model card for the architecture, intended-use, evaluation, citation, and license context.