Intel

bert-base-uncased-sparse-80-1x4-block-pruneofa

Intel/bert-base-uncased-sparse-80-1x4-block-pruneofa

bert-base-uncased-sparse-80-1x4-block-pruneofa is a fill-mask model from Intel. Use it when you need the model to fill a missing word. It is set up for transformers. The card lists the license as apache-2.0.

This model is was created using Prune OFA method described in Prune Once for All: Sparse Pre-Trained Language Models presented in ENLSP NeurIPS Workshop 2021.