Shap-MeD

Datasets and models for Shap-MeD

Please refer to the following links to understand how to use it:

• Shap-MeD Article: Theoretical foundation of the project.
• Shap-MeD repository: This repository contains the code and instructions you want to use these files directly.

Abstract

We present Shap-MeD, a text-to-3D object generative model specialized in the biomedical domain. The objective of this study is to develop an assistant that facilitates the 3D modeling of medical objects, thereby reducing development time. 3D modeling in medicine has various applications, including surgical procedure simulation and planning, the design of personalized prosthetic implants, medical education, the creation of anatomical models, and the development of research prototypes. To achieve this, we leverage Shap-e, an open-source text-to-3D generative model developed by OpenAI, and fine-tune it using a dataset of biomedical objects. Our model achieved a mean squared error (MSE) of 0.089 in latent generation on the evaluation set, compared to Shap-e's MSE of 0.147. Additionally, we conducted a qualitative evaluation, comparing our model with others in the generation of biomedical objects. Our results indicate that Shap-MeD demonstrates higher structural accuracy in biomedical object generation

Files

These are the dataset and model files in this repository. However it is heavily encouraged to read the Shap-MeD repository README to use them.

shap-med-dataset.tar.gz

This file contains the latent .pt files required to train the Shap-e model.

shap-med-models.tar.gz

This file contains the trained .pt models required to generate meshes from text.

How to cite

Please cite by using the next Bibtex citation:

@misc{laverde2025shapmed,
      title={Shap-MeD}, 
      author={Nicolás Laverde and Melissa Robles and Johan Rodríguez},
      year={2025},
      eprint={2503.15562},
      archivePrefix={arXiv},
      primaryClass={cs.GR},
      url={https://arxiv.org/abs/2503.15562}, 
}