Skip to content

aodiniz

bert_uncased_L-4_H-256_A-4_cord19-200616

aodiniz/bert_uncased_L-4_H-256_A-4_cord19-200616

bert_uncased_L-4_H-256_A-4_cord19-200616 is a fill-mask model from aodiniz. Use it when you need the model to fill a missing word. It is set up for transformers.

BERT model with 4 Transformer layers and hidden embedding of size 256, referenced in Well-Read Students Learn Better: On the Importance of Pre-training Compact Models, fine-tuned for MLM on CORD-19 dataset (as release…

Downloads · 30 days

84

13% of all-time downloads

All-time downloads

668

Public

Repo size

135 MB

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.bin45.1 MB · 50%

At a glance

Task
Fill-Mask
Library
transformers
Model type
bert
Access
Public
Created
Mar 2, 2022
Updated
May 18, 2021
SHA
bbb574bf

Try a prompt

Task
Fill-Mask
Library
transformers
Type
bert
Created
Mar 2, 2022
Updated
May 18, 2021