Downloads · 30 days
13
0% of all-time downloads
lkonle/fiction-gbert-large
fiction-gbert-large is a feature extraction model from lkonle. Use it when you need embeddings to search or compare text. It is set up for transformers. The card lists the license as mit.
The foundation this model is the RoBERTa-style model deepset/gbert-large. <br Following Gururangan et al. (2020) we gathered a collection of narrative fiction and continued the models pre-training task with it. <br Th…
Downloads · 30 days
13
0% of all-time downloads
All-time downloads
3.6K
Public
Repo size
2.7 GB
Likes
1
Public
Click a slice to open those files.
.bin1.3 GB · 100%
From the Hugging Face model README
The foundation this model is the RoBERTa-style model deepset/gbert-large. <br> Following Gururangan et al. (2020) we gathered a collection of narrative fiction and continued the models pre-training task with it. <br> The training is performed over 10 epochs on 2.3 GB of text with a learning rate of 0.0001 (linear decrease) and a batch size of 512.