Downloads · 30 days
8
5% of all-time downloads
suproteem/StoriesLM-v2-2020
StoriesLM-v2-2020 is a fill-mask model from suproteem. Use it when you need the model to fill a missing word. It is set up for transformers.
StoriesLM-v2 is a family of 125 encoder-only language models trained on an expanding sequence of historical language data.
Downloads · 30 days
8
5% of all-time downloads
All-time downloads
147
Public
Parameters
150M
599 MB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors599 MB · 99%
From the Hugging Face model README
StoriesLM-v2 is a family of 125 encoder-only language models trained on an expanding sequence of historical language data.
More details are available at suproteem.is/writing/storieslm.
from transformers import AutoTokenizer, AutoModelForMaskedLM
model_id = "suproteem/StoriesLM-v2-2020"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForMaskedLM.from_pretrained(model_id)
from transformers import pipeline
fill_mask = pipeline("fill-mask", model="suproteem/StoriesLM-v2-2020")
fill_mask("We walked back and [MASK].")
@article{sarkar2024storieslm,
author = {Sarkar, Suproteem},
title = {StoriesLM: A Family of Language Models With Time-Indexed Training Data},
journal = {SSRN Electronic Journal},
year = {2024},
url = {https://ssrn.com/abstract=4881024}
}