sello-ralethe

bert-base-frozen-generics-mlm

sello-ralethe/bert-base-frozen-generics-mlm

bert-base-frozen-generics-mlm is a fill-mask model from sello-ralethe. Use it when you need the model to fill a missing word. It is set up for transformers.

BERT model finetuned for masked language modeling on generics dataset by freezing all the weights of pretrained BERT except the last layer. The aim is to investigate if the model will overgeneralize generics and treat…