MedAssist-Pro-TestRepo

MedAssist-Pro

<!-- markdownlint-disable first-line-h1 --> <!-- markdownlint-disable html --> <!-- markdownlint-disable no-duplicate-header --> <div align="center"> <img src="figures/fig1.png" width="60%" alt="MedAssist-Pro" /> </div> <hr> <div align="center" style="line-height: 1;"> <a href="LICENSE" style="margin: 2px;"> <img alt="License" src="figures/fig2.png" style="display: inline-block; vertical-align: middle;"/> </a> </div>

1. Introduction

MedAssist-Pro represents a breakthrough in medical AI technology. In this release, MedAssist-Pro has significantly enhanced its clinical reasoning and diagnostic accuracy by incorporating extensive medical literature and clinical trial data. The model demonstrates state-of-the-art performance across various healthcare benchmarks, including disease diagnosis, drug interaction analysis, and clinical documentation.

<p align="center"> <img width="80%" src="figures/fig3.png"> </p>

Compared to the previous version, MedAssist-Pro shows remarkable improvements in complex medical scenarios. For instance, in the MedQA benchmark, the model's accuracy has increased from 62% in the previous version to 78.5% in the current version. This advancement stems from enhanced medical knowledge integration: the model now processes an average of 18K tokens per clinical case, compared to 8K tokens in the previous version.

Beyond its improved diagnostic capabilities, this version also offers reduced hallucination rates in medical contexts and enhanced support for multi-modal clinical inputs.

2. Evaluation Results

Comprehensive Medical Benchmark Results

<div align="center"> </div>

Overall Performance Summary

MedAssist-Pro demonstrates strong performance across all evaluated medical benchmark categories, with particularly notable results in diagnostic tasks and safety compliance.

3. Clinical Interface & API Platform

We offer a clinical interface and API for healthcare professionals to interact with MedAssist-Pro. Please check our official website for more details and HIPAA compliance documentation.

4. How to Run Locally

Please refer to our code repository for more information about running MedAssist-Pro locally.

Compared to previous versions, the usage recommendations for MedAssist-Pro have the following changes:

1. Medical context system prompt is supported.
2. It is not required to add special tokens at the beginning of the output to force the model into a specific clinical reasoning pattern.

The model architecture of MedAssist-Pro-Lite is identical to its base model, but it shares the same tokenizer configuration as the main MedAssist-Pro.

System Prompt

We recommend using the following system prompt with clinical context.

You are MedAssist-Pro, a medical AI assistant designed to support healthcare professionals.
Today is {current date}.
IMPORTANT: This AI is for clinical decision support only. Always consult with qualified medical professionals.

Temperature

We recommend setting the temperature parameter $T_{model}$ to 0.3 for clinical applications to ensure consistent and reliable outputs.

Prompts for Clinical Data Processing

For patient record processing, please follow the template to create prompts, where {patient_id}, {record_content} and {clinical_query} are arguments.

clinical_template = \
"""[Patient ID]: {patient_id}
[Clinical Record Begin]
{record_content}
[Clinical Record End]
{clinical_query}"""

For literature-enhanced generation, we recommend the following prompt template where {literature_results}, {cur_date}, and {clinical_question} are arguments.

literature_answer_template = \
'''# The following contents are relevant medical literature:
{literature_results}
In the literature I provide to you, each source is formatted as [source X begin]...[source X end], where X represents the numerical index of each reference. Please cite appropriately using [citation:X] format.
When responding, please keep the following points in mind:
- Today is {cur_date}.
- Evaluate the relevance and quality of each literature source.
- For diagnostic questions, prioritize evidence-based guidelines.
- Always note limitations and recommend appropriate follow-up.
# The clinical question is:
{clinical_question}'''

5. License

This code repository is licensed under the Apache 2.0 License. The use of MedAssist-Pro models is subject to additional healthcare compliance requirements.

6. Contact

If you have any questions, please raise an issue on our GitHub repository or contact us at [email protected].