stsb-roberta-base-off-topic

Off-Topic Classification Model

This model leverages a fine-tuned Cross Encoder STSB Roberta Base to perform binary classification, determining whether a user prompt is off-topic in relation to the system's intended purpose as defined by the system prompt.

Model Highlights

• Base Model: stsb-roberta-base
• Maximum Context Length: 514 tokens
• Task: Binary classification (on-topic/off-topic)

Performance

We evaluated our fine-tuned models on synthetic data modelling system and user prompt pairs reflecting real world enterprise use cases of LLMs. The dataset is available here.

Further evaluation results on additional synthetic and external datasets (e.g.,JailbreakBench, HarmBench, TrustLLM) are available in our technical report.

Usage

1. Clone this repository and install the required dependencies:

   pip install -r requirements.txt
   

2. You can run the model using two options:

   Option 1: Using inference_onnx.py with the ONNX Model.

    ```
    python inference_onnx.py '[
        ["System prompt example 1", "User prompt example 1"],
        ["System prompt example 2", "System prompt example 2]
    ]'
    ```
   

   Option 2: Using inference_safetensors.py with PyTorch and SafeTensors.

    ```
    python inference_safetensors.py '[
        ["System prompt example 1", "User prompt example 1"],
        ["System prompt example 2", "System prompt example 2]
    ]'
    ```
   

Read more about this model in our technical report.