Skip to content

aodiniz

bert_uncased_L-2_H-512_A-8_cord19-200616

aodiniz/bert_uncased_L-2_H-512_A-8_cord19-200616

bert_uncased_L-2_H-512_A-8_cord19-200616 is a fill-mask model from aodiniz. Use it when you need the model to fill a missing word. It is set up for transformers.

BERT model with 2 Transformer layers and hidden embedding of size 512, referenced in Well-Read Students Learn Better: On the Importance of Pre-training Compact Models, fine-tuned for MLM on CORD-19 dataset (as release…

Downloads · 30 days

85

11% of all-time downloads

All-time downloads

769

Public

Repo size

272 MB

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.bin91 MB · 50%

At a glance

Task
Fill-Mask
Library
transformers
Model type
bert
Access
Public
Created
Mar 2, 2022
Updated
May 18, 2021
SHA
8221e4cf

Try a prompt

Task
Fill-Mask
Library
transformers
Type
bert
Created
Mar 2, 2022
Updated
May 18, 2021