Downloads · 30 days
0
GEM_PubMedQA
GEM025/GEM_PubMedQA
GEM_PubMedQA is a machine learning model from GEM025. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
This model card provides an overview of the GEMPubMedQA model, a finetuned implementation of the GEM architecture designed for the PubMedQA dataset.
Access
Public
Updated Mar 16, 2025
Repo size
886 MB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.pth886 MB · 100%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Mar 16, 2025
- Updated
- Mar 16, 2025
- SHA
- c400c450
Base models
Datasets
Model card
From the Hugging Face model README
GEM_PubMedQA Model Card
This model card provides an overview of the GEM_PubMedQA model, a finetuned implementation of the GEM architecture designed for the PubMedQA dataset.
Purpose
The GEM_PubMedQA model was developed to assess the performance of the GEM architecture on domain-specific datasets, with a focus on healthcare. The PubMedQA dataset, a key benchmark in this field, was selected to evaluate its effectiveness.
Key Details
- License: Apache-2.0
- Dataset: qiaojin/PubMedQA
- Language: English
- Metrics: Accuracy: 92.5%
- Base Model: google-bert/bert-base-uncased
Model Details
The GEM_PubMedQA model is built on the GEM architecture and finetuned from the google-bert/bert-base-uncased model using the PubMedQA dataset. The training was performed with the following parameters:
- Number of epochs: 5
- Batch size: 128
- Learning rate: 2e-5
- Maximum sequence length: 128
- Gradient accumulation steps: 2
- Cluster size: 256
- Threshold: 0.65
- License
- apache-2.0
- Languages
- en
- Created
- Mar 16, 2025
- Updated
- Mar 16, 2025