Downloads · 30 days
6
2% of all-time downloads
Amalq/stress-roberta-base
stress-roberta-base is a fill-mask model from Amalq. Use it when you need the model to fill a missing word. It is set up for transformers. The card lists the license as apache-2.0.
This model was initialized with roberta-base and trained with Stress-SMHD, which is a subset of Self-Reported Mental Health Diagnoses (SMHD) dataset which consists of Reddit posts by patients with anxiety, PTSD (Post…
Downloads · 30 days
6
2% of all-time downloads
All-time downloads
342
Public
Repo size
998 MB
Likes
0
Public
Click a slice to open those files.
.bin499 MB · 99%
From the Hugging Face model README
This model was initialized with roberta-base and trained with Stress-SMHD, which is a subset of Self-Reported Mental Health Diagnoses (SMHD) dataset which consists of Reddit posts by patients with anxiety, PTSD (Post Traumatic Stress Disorder), or depression. We follow the standard pretraining protocols of RoBERTa with Huggingface’s Transformers library.
from transformers import AutoTokenizer,
AutoModel tokenizer = AutoTokenizer.from_pretrained("Amalq/stress-roberta-base")
model = AutoModel.from_pretrained("Amalq/stress-roberta-base")
Perplexity of this model is: 5.22