MedDiagnoseAI-ClinicalRelease

MedDiagnoseAI

<!-- markdownlint-disable first-line-h1 --> <!-- markdownlint-disable html --> <!-- markdownlint-disable no-duplicate-header --> <div align="center"> <img src="figures/fig1.png" width="60%" alt="MedDiagnoseAI" /> </div> <hr> <div align="center" style="line-height: 1;"> <a href="LICENSE" style="margin: 2px;"> <img alt="License" src="figures/fig2.png" style="display: inline-block; vertical-align: middle;"/> </a> </div>

1. Introduction

MedDiagnoseAI represents a breakthrough in clinical decision support systems. In this latest release, MedDiagnoseAI has substantially enhanced its diagnostic reasoning capabilities by incorporating multi-modal medical data processing and advanced clinical knowledge integration during post-training. The model has demonstrated exceptional performance across various healthcare benchmark evaluations, including differential diagnosis, drug interactions, and patient safety assessments.

<p align="center"> <img width="80%" src="figures/fig3.png"> </p>

Compared to the previous version, this upgraded model shows remarkable improvements in complex diagnostic scenarios. For instance, in the MedQA-USMLE benchmark, the model's accuracy has increased from 68% in the previous version to 84.2% in the current version. This advancement stems from enhanced clinical reasoning depth: the previous model used an average of 8K tokens per case, whereas the new version averages 18K tokens per case for comprehensive differential diagnosis.

Beyond its improved diagnostic capabilities, this version also offers reduced false positive rates and enhanced HIPAA-compliant data handling.

2. Evaluation Results

Comprehensive Benchmark Results

<div align="center"> </div>

Overall Performance Summary

MedDiagnoseAI demonstrates strong performance across all evaluated healthcare benchmark categories, with particularly notable results in diagnostic accuracy and patient safety assessments.

3. Clinical Integration & API Platform

We offer a secure HIPAA-compliant interface and API for clinical integration with MedDiagnoseAI. Please contact our healthcare partnerships team for implementation details.

4. How to Run Locally

Please refer to our clinical implementation guide for more information about deploying MedDiagnoseAI in healthcare settings.

Compared to previous versions, the usage recommendations for MedDiagnoseAI have the following changes:

1. Clinical context prompts are now required for optimal diagnostic accuracy.
2. Patient de-identification preprocessing is recommended before model input.

The model architecture of MedDiagnoseAI-Lite is identical to its base model, but optimized for point-of-care applications.

Clinical Context Prompt

We recommend using the following clinical context prompt format:

You are MedDiagnoseAI, a clinical decision support assistant.
Current case date: {current date}.
Patient context: {age}, {sex}, {relevant medical history}.

For example,

You are MedDiagnoseAI, a clinical decision support assistant.
Current case date: May 28, 2025, Monday.
Patient context: 58yo, Male, History of Type 2 Diabetes, Hypertension.

Temperature

We recommend setting the temperature parameter $T_{model}$ to 0.3 for clinical applications to ensure consistent and reliable outputs.

Prompts for Medical Records and Literature Search

For medical record analysis, please follow the template to create prompts, where {patient_id}, {record_content} and {clinical_question} are arguments.

medical_record_template = \
"""[Patient ID]: {patient_id}
[Clinical Record Begin]
{record_content}
[Clinical Record End]
{clinical_question}"""

For medical literature enhanced diagnosis, we recommend the following prompt template where {search_results}, {case_date}, and {clinical_question} are arguments.

clinical_search_template = \
'''# The following are relevant medical literature findings:
{search_results}
In the search results provided, each finding is formatted as [study X begin]...[study X end], where X represents the numerical index. Please cite evidence appropriately using [ref:X] format.
When responding, keep the following in mind:
- Today is {case_date}.
- Prioritize evidence from randomized controlled trials and meta-analyses.
- Consider patient-specific factors when applying general findings.
- Clearly distinguish between strong and weak evidence.
# The clinical question is:
{clinical_question}'''

5. License

This model is licensed under the Apache 2.0 License. Use in clinical settings requires appropriate regulatory approval. The model is intended as a decision support tool and should not replace clinical judgment.

6. Contact

If you have any questions, please contact our healthcare partnerships team at [email protected].