Downloads · 30 days
52
1% of all-time downloads
its5Q/rugpt3large_mailqa
rugpt3large_mailqa is a text generation model from its5Q. Use it when you need the model to write or continue text. It is set up for transformers.
Model was finetuned with sequence length 1024 for 516000 steps on a dataset of otvet.mail.ru questions and answers. The raw dataset can be found here. Beware that the data contains a good portion of toxic language, so…
Downloads · 30 days
52
1% of all-time downloads
All-time downloads
4.8K
Public
Parameters
861M
6.3 GB on disk
Likes
5
Public
Click a slice to open those files.
.bin3.1 GB · 50%
How the weights are stored.
F32760M · 88%
From the Hugging Face model README
Model was finetuned with sequence length 1024 for 516000 steps on a dataset of otvet.mail.ru questions and answers. The raw dataset can be found here. Beware that the data contains a good portion of toxic language, so the answers can be unpredictable.
Jupyter notebook with an example of how to inference this model can be found in the repository