Downloads · 30 days
11
35% of all-time downloads
med-research/Medguide-V_0723
Medguide-V_0723 is a machine learning model from med-research. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This document provides instructions for deploying the Medguide model for inference using Gradio.
Downloads · 30 days
11
35% of all-time downloads
All-time downloads
31
Public
Repo size
147 GB
Likes
2
Public
Click a slice to open those files.
.safetensors147 GB · 100%
From the Hugging Face model README
This document provides instructions for deploying the Medguide model for inference using Gradio.
Set up the Conda environment: Follow the instructions in the PKU-Alignment/align-anything repository to configure your Conda environment.
Configure the model path: After setting up the environment, update the MODEL_PATH variable in deploy_medguide_v.sh to point to your local Medguide model directory.
Verify inference script parameters: Check the following three parameters in both multimodal_inference.py:
# NOTE: Replace with your own model path if not loaded via the API base
model = ''
These scripts utilize an OpenAI-compatible server approach. The deploy_medguide_v.sh script launches the Medguide model locally and exposes it on port 8231 for external access via the specified API base URL.
Running Inference:
bash deploy_medguide_v.sh
python multimodal_inference.py
transformers==4.49.0