xraydar-nlp

X-Raydar NLP — Radiology Report Classifier

Pre-trained model weights for the NLP component of X-Raydar, from "Development and validation of open-source deep neural networks for comprehensive chest x-ray reading" (Cid, Macpherson et al., The Lancet Digital Health, 2024).

Website: x-raydar.info Code: github.com/gmontana/xraydar-nlp CV model: dnamodel/xraydar-cv

Model Description

RoBERTaX is a fine-tuned RoBERTa model that classifies free-text radiology reports into 45 finding categories using multi-label classification. It was trained on radiology reports from NHS hospitals.

Architecture

• Base model: RoBERTa-base (125M parameters)
• Classification head: Linear(768, 768) → Tanh → Linear(768, 45)
• Output: 45 sigmoid probabilities (multi-label)
• Input: Free-text radiology report (max 512 tokens)

Files

Usage

Download weights

from huggingface_hub import snapshot_download

snapshot_download(
    repo_id="dnamodel/xraydar-nlp",
    local_dir="./xraydar-nlp-weights"
)

Place weights for the code repository

from huggingface_hub import hf_hub_download
import shutil, os

os.makedirs("src/model/robertax_pretrained", exist_ok=True)

shutil.copy(
    hf_hub_download("dnamodel/xraydar-nlp", "nlp/robertax1.0.pt"),
    "src/model/robertax1.0.pt"
)

for f in ["pytorch_model.bin", "config.json", "vocab.json", "merges.txt"]:
    shutil.copy(
        hf_hub_download("dnamodel/xraydar-nlp", f"nlp/pretrained/{f}"),
        f"src/model/robertax_pretrained/{f}"
    )

See the code repository for full inference instructions.

NLP Labels (45 categories)

Citation

@article{cid2024development,
  title={Development and validation of open-source deep neural networks for comprehensive chest x-ray reading: a retrospective, multicentre study},
  author={Cid, Yan Digilov and Macpherson, Matt and others},
  journal={The Lancet Digital Health},
  volume={6},
  number={1},
  pages={e44--e57},
  year={2024},
  publisher={Elsevier},
  doi={10.1016/S2589-7500(23)00218-2}
}

License

For academic research and non-commercial evaluation only. See x-raydar.info for terms and conditions.

Contact

• Questions or collaborations: Giovanni Montana — [email protected]
• Commercial licensing: Warwick Ventures — [email protected]