Downloads · 30 days
185
1% of all-time downloads
google/realm-cc-news-pretrained-encoder
realm-cc-news-pretrained-encoder is a machine learning model from google. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
The REALM checkpoint pretrained with CC-News as target corpus and Wikipedia as knowledge corpus, converted from the TF checkpoint provided by Google Language.
Downloads · 30 days
185
1% of all-time downloads
All-time downloads
14.2K
Public
Repo size
1.3 GB
Likes
1
Public
Click a slice to open those files.
.bin441 MB · 100%
From the Hugging Face model README
The REALM checkpoint pretrained with CC-News as target corpus and Wikipedia as knowledge corpus, converted from the TF checkpoint provided by Google Language.
The original paper, code, and checkpoints can be found here.
from transformers import RealmKnowledgeAugEncoder
encoder = RealmKnowledgeAugEncoder.from_pretrained("qqaatw/realm-cc-news-pretrained-encoder")