claimsense-ai-v1

ClaimSense AI v1

Insurance Claims Fraud Detection & Triage System

Built for the Mistral AI Worldwide Hackathon 2026 - Track 1: Fine-tuning with Weights & Biases

Model Description

ClaimSense AI is a fine-tuned version of Mistral 7B Instruct v0.2, specialized for insurance claims processing. It performs:

Intended Uses

• Primary Use: Assisting insurance claims adjusters with initial claim triage
• Secondary Use: Training and educational purposes for insurance professionals
• Not For: Fully autonomous claim decisions without human oversight

Training Data

Training/Eval Split: 90% / 10% (35,136 train / 3,905 eval)

Training Procedure

Training Configuration

Training Infrastructure

Training Metrics

Evaluation Results

Evaluated on 50+ diverse insurance claim scenarios (synthetic + real-world patterns):

Key Improvements

Usage

Direct Use with Transformers

from transformers import AutoModelForCausalLM, AutoTokenizer
import torch

# Load model
model = AutoModelForCausalLM.from_pretrained(
    "pramodmisra/claimsense-ai-v1",
    torch_dtype=torch.float16,
    device_map="auto"
)
tokenizer = AutoTokenizer.from_pretrained("pramodmisra/claimsense-ai-v1")

# Prepare prompt
claim = """Customer reports laptop stolen from unlocked car.
Third claim this year for similar items. No police report filed.
Requesting $3,500."""

prompt = f"<s>[INST] Analyze this insurance claim for fraud risk:\n\n{claim} [/INST]"

# Generate
inputs = tokenizer(prompt, return_tensors="pt").to(model.device)
outputs = model.generate(
    **inputs,
    max_new_tokens=300,
    temperature=0.7,
    do_sample=True
)
response = tokenizer.decode(outputs[0], skip_special_tokens=True)
print(response)

Using with PEFT (LoRA adapters only)

from peft import PeftModel
from transformers import AutoModelForCausalLM, AutoTokenizer

# Load base model
base_model = AutoModelForCausalLM.from_pretrained(
    "mistralai/Mistral-7B-Instruct-v0.2",
    torch_dtype=torch.float16,
    device_map="auto"
)

# Load LoRA adapters
model = PeftModel.from_pretrained(base_model, "pramodmisra/claimsense-ai-v1")

Example Outputs

Input: Fraud Detection

Customer reports laptop stolen from unlocked car. Third claim this year
for similar items. No police report filed. Requesting $3,500.

Output:

FRAUD RISK ASSESSMENT

Risk Level: HIGH
Confidence: 87%

Red Flags Detected:
• Multiple similar claims (3rd this year) - Pattern indicator
• No police report for theft - Documentation gap
• Unlocked vehicle - Negligence pattern
• High-value replacement request - Financial motivation

Recommendation: Flag for Special Investigation Unit (SIU) review
Priority: High - Expedited investigation required

Limitations

• Not a replacement for human judgment: Should be used as a decision-support tool, not for autonomous claim decisions
• English only: Trained on English language claims
• US-focused: Training data primarily covers US insurance terminology and practices
• No image analysis: Cannot process damage photos or documents
• Potential biases: May reflect biases present in training data

Ethical Considerations

• Claims flagged as fraudulent should always be reviewed by human investigators
• Model outputs should be used to assist, not replace, trained claims adjusters
• Regular auditing recommended to detect potential biases
• Not suitable for determining claim denial without human review

Business Impact (Projected)

Citation

@misc{claimsense-ai-2026,
  author = {Pramod Misra},
  title = {ClaimSense AI: Insurance Claims Fraud Detection and Triage System},
  year = {2026},
  publisher = {HuggingFace},
  howpublished = {\url{https://huggingface.co/pramodmisra/claimsense-ai-v1}},
  note = {Mistral AI Worldwide Hackathon 2026}
}

Links

• Demo: HuggingFace Spaces
• Dataset: claimsense-training-data
• GitHub: pramodmisra/claimsense-ai
• Base Model: Mistral-7B-Instruct-v0.2

Acknowledgments

• Mistral AI - Base model and hackathon
• Weights & Biases - Experiment tracking
• Bitext - Insurance dataset
• HuggingFace - Model hosting and Spaces

---

Built with care for the Mistral AI Worldwide Hackathon 2026