neodragon-npu-s25u

Neodragon on Snapdragon 8 Elite (SM8750) — QNN context binaries

Pre-compiled QAIRT / QNN context binaries for the Neodragon autoregressive text-to-video pipeline, targeting the Hexagon HTP v79 NPU in the Samsung Galaxy S25 Ultra (SM8750).

These are the exact artefacts the companion Android app loads at runtime. They are device-specific: compiled for soc_model 69 / HTP v79. They will not load on a v75 or earlier Hexagon.

Contents

13 binaries. The three mmdit_*fs graphs replace the older mmdit_s0g/s1f/s2f, which may still be present for rollback.

The *fs MMDiT binaries supersede mmdit_s0g / s1f / s2f. They contract the attention score once at full width instead of as two half-width MatMuls plus an add. That is arithmetically identical in fp32 (126 dB against the stock model) but avoids quantising two large, partially-cancelling terms separately -- worth +10.9 / +12.2 / +12.0 dB, and it puts every stage past its paper target for the first time. Accelerator cycles fall 4.4% as well.

Byte sizes are load-bearing: the app verifies every download by exact length. Large transfers to this device have silently truncated more than once while reporting success.

Quantization and measured accuracy

All graphs are W8A16 (per-channel 8-bit weights, 16-bit activations) except the context adapter, which is FP16. Deploy SNR is measured on device against the fp32 reference, per module:

QuickSRNet here is W8A16 + CLE. The paper uses W8A16 + AdaRound and credits AdaRound with "7+ dB SQNR" on this module, so expect it to land below 48 dB.

Measured latency (S25 Ultra, on device)

Prompt -> 49-frame video: 23.5-26.9 s (measured before the *fs rebuild). Prompt -> single 640x1024 image: 2.1-2.5 s warm, ~5 s on the first tap of a cold app. Peak app RSS 238-268 MB (binaries are mmap'd, never heap-copied).

Usage

The app fetches each file from <baseUrl>/<name>_v79.bin and places it in its external files dir. For this repo:

https://huggingface.co/AbrahamPJ/neodragon-npu-s25u/resolve/main

This repo is private; the download path sends an Authorization: Bearer <hf_token> header. Use a fine-grained, read-only token scoped to this repo.

Provenance and license

Converted from Qualcomm-AI-Research/Neodragon, which is released under BSD-3-Clause-Clear. That license governs these derived artefacts, and its terms — including the patent clause — carry over. Original work and weights are Qualcomm's; this repo contains only a device-specific recompilation.

Paper: Neodragon, arXiv:2511.06055.

Conversion toolchain: QAIRT SDK 2.49.0.260730 (qnn-onnx-converter → qnn-context-binary-generator). The QAIRT SDK itself is not redistributed here.

Port and conversion work: T2V_NPU.