Downloads · 30 days
47
4% of all-time downloads
Amalq/schizophrenia-roberta-large
schizophrenia-roberta-large is a fill-mask model from Amalq. Use it when you need the model to fill a missing word. It is set up for transformers. The card lists the license as apache-2.0.
is a model initialized with roberta-large and trained with Schizophrenia Reddit, a subset of Self-Reported Mental Health Diagnoses (SMHD) dataset which consists of Reddit posts by patients with schizophrenia only or s…
Downloads · 30 days
47
4% of all-time downloads
All-time downloads
1.2K
Public
Repo size
103 MB
Likes
0
Public
Click a slice to open those files.
.bin103 MB · 97%
From the Hugging Face model README
is a model initialized with roberta-large and trained with Schizophrenia Reddit, a subset of Self-Reported Mental Health Diagnoses (SMHD) dataset which consists of Reddit posts by patients with schizophrenia only or schizophrenia with other mental disorders and matched control. We follow the standard pretraining protocols of RoBERTa with Huggingface’s Transformers library.
from transformers import AutoTokenizer,
AutoModel tokenizer = AutoTokenizer.from_pretrained("Amalq/schizophrenia-roberta-large")
model = AutoModel.from_pretrained("Amalq/schizophrenia-roberta-large")
Perplexity of this model is: 4.43