Downloads · 30 days
6
1% of all-time downloads
covidbert_mednli
Darkrider/covidbert_mednli
covidbert_mednli is a machine learning model from Darkrider. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers.
This is the model CovidBERT trained by DeepSet on AllenAI's CORD19 Dataset of scientific articles about coronaviruses.
All-time downloads
433
Public
Repo size
438 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin438 MB · 100%
At a glance
- Library
- transformers
- Access
- Public
- Created
- Mar 2, 2022
- Updated
- Mar 7, 2021
- SHA
- 1fac138c
Model card
From the Hugging Face model README
CovidBERT-MedNLI
This is the model CovidBERT trained by DeepSet on AllenAI's CORD19 Dataset of scientific articles about coronaviruses.
The model uses the original BERT wordpiece vocabulary and was subsequently fine-tuned on the SNLI and the MultiNLI datasets using the sentence-transformers library to produce universal sentence embeddings [1] using the average pooling strategy and a softmax loss.
It is further fine-tuned on both MedNLI datasets available at Physionet.
Parameter details for the original training on CORD-19 are available on DeepSet's MLFlow
Base model: deepset/covid_bert_base from HuggingFace's AutoModel.
- Library
- transformers
- Created
- Mar 2, 2022
- Updated
- Mar 7, 2021