Skip to content

Nicolassuez

Qwen3-Reranker-0.6B-W8A16-g128-gptq-resident

Nicolassuez/Qwen3-Reranker-0.6B-W8A16-g128-gptq-resident

Qwen3-Reranker-0.6B-W8A16-g128-gptq-resident is a text ranking model from Nicolassuez. Use it for the text ranking task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.

The exact same int8 values and scales as Qwen3-Reranker-0.6B-W8A16-g128-gptq (bit-exact unpack of the GPTQ solution, zero requantization), repackaged as repo custom code (trustremotecode=True) whose Int8GroupLinear mo…

Downloads · 30 days

131

7% of all-time downloads

All-time downloads

1.9K

Public

Parameters

599M

770 MB on disk

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors758 MB · 99%

Parameter types

How the weights are stored.

I8440M · 73%

Base models

Task
Text Ranking
Type
qwen3
License
apache-2.0
Languages
multilingual
Created
Jul 27, 2026
Updated
Jul 27, 2026