Qwen3-Reranker-0.6B-Q8_0-GGUF

Qwen3 Reranker 0.6B Q8_0 GGUF

This repository contains the exact immutable local-model asset used by NovelAide. This GGUF is a NovelAide-built derived artifact produced from the official Safetensors checkpoint. It is not an official Qwen GGUF release.

Provenance

• Base model: Qwen/Qwen3-Reranker-0.6B
• Asset source: Qwen/Qwen3-Reranker-0.6B
• Pinned source revision: e61197ed45024b0ed8a2d74b80b4d909f1255473
• Runtime: llama-cpp
• NovelAide asset ID: qwen3-reranker-0.6b
• NovelAide CDN prefix: qwen3-reranker-0.6b-gguf/e137d193dfb7691d

The base model and conversion input are the official Qwen/Qwen3-Reranker-0.6B Safetensors at immutable revision e61197ed45024b0ed8a2d74b80b4d909f1255473.

NovelAide converts that checkpoint to BF16 GGUF and then quantizes it to Q8_0 with ggml-org/llama.cpp tag b9842, commit 6f4f53f2b7da54fcdbbecaaa734337c337ad6176. This is the llama.cpp revision embedded by the Desktop runtime's [email protected].

The resulting GGUF is a NovelAide-built derived asset, not an upstream Qwen GGUF. Its immutable content-addressed object prefix is qwen3-reranker-0.6b-gguf/e137d193dfb7691d; it must not overwrite the previously published community-derived artifact.

Files

Usage

Use the GGUF files with a compatible llama.cpp runtime and the ONNX files with a compatible ONNX / Transformers.js runtime. NovelAide pins the exact files and checksums shown above; do not substitute similarly named quantizations.

License and attribution

The model asset follows the upstream apache-2.0 license. Review the linked base model and asset source model cards for their complete terms, limitations, and attribution requirements. NovelAide is not affiliated with or endorsed by the upstream model authors.