splade-v3-doc-mlx

splade-v3-doc-mlx

MLX (bfloat16) conversion of naver/splade-v3-doc for Apple Silicon, produced by NomaDamas/SPLADE-mlx.

SPLADE-v3-Doc (BERT-base): document-side encoder; the query side is inference-free (bag-of-words) in the SPLADE-v3-Doc setup.

Changes from upstream: PyTorch checkpoint converted to MLX safetensors (parameter re-mapping, cast to bfloat16). No training or fine-tuning was performed.

Quality: Separate fp32 conversion validation: max |logit delta| 4.8e-05, sparse cosine 1.000000, top-64 term overlap 100%. This repository stores bfloat16 weights. Any fp32 parity number above comes from a separate fp32 conversion of the upstream checkpoint, not this linked bfloat16 artifact. Full methodology: see the SPLADE-mlx report.

Usage

from splade_mlx import load
import mlx.core as mx

model, tok = load("NomaDamas/splade-v3-doc-mlx")
enc = tok(["what causes vitamin d deficiency"], return_tensors="np", padding=True)
sparse = model.encode(mx.array(enc["input_ids"]), mx.array(enc["attention_mask"]))  # (1, 30522)

Do not pass dtype="float32" for this pre-converted repository: its declared stored dtype is bfloat16. Load the upstream naver/splade-v3-doc checkpoint to create an fp32 conversion.

License

CC BY-NC-SA 4.0 — the original weights are Copyright (c) NAVER Corp. (NAVER LABS Europe) and are licensed for non-commercial use only. This conversion is Adapted Material redistributed under the same CC BY-NC-SA 4.0 license (ShareAlike), with attribution and the changes stated above. This repository is not affiliated with or endorsed by NAVER. For commercial use, consider NomaDamas/Splade_PP_en_v1-mlx (Apache-2.0).