Downloads · 30 days
1.4K
0% of all-time downloads
rubert-base-cased-conversational
DeepPavlov/rubert-base-cased-conversational
rubert-base-cased-conversational is a feature extraction model from DeepPavlov. Use it when you need embeddings to search or compare text. It is set up for transformers.
Conversational RuBERT \(Russian, cased, 12‑layer, 768‑hidden, 12‑heads, 180M parameters\) was trained on OpenSubtitles\[1\], Dirty, Pikabu, and a Social Media segment of Taiga corpus\[2\]. We assembled a new vocabular…
All-time downloads
11M
Public
Repo size
4.3 GB
Likes
25
Public
Repo makeup
Click a slice to open those files.
.bin714 MB · 50%
At a glance
- Task
- Feature Extraction
- Library
- transformers
- Model type
- bert
- Access
- Public
- Created
- Mar 2, 2022
- Updated
- Nov 8, 2021
- SHA
- 645946ce
Model card
From the Hugging Face model README
rubert-base-cased-conversational
Conversational RuBERT (Russian, cased, 12‑layer, 768‑hidden, 12‑heads, 180M parameters) was trained on OpenSubtitles[1], Dirty, Pikabu, and a Social Media segment of Taiga corpus[2]. We assembled a new vocabulary for Conversational RuBERT model on this data and initialized the model with RuBERT.
08.11.2021: upload model with MLM and NSP heads
[1]: P. Lison and J. Tiedemann, 2016, OpenSubtitles2016: Extracting Large Parallel Corpora from Movie and TV Subtitles. In Proceedings of the 10th International Conference on Language Resources and Evaluation (LREC 2016)
[2]: Shavrina T., Shapovalova O. (2017) TO THE METHODOLOGY OF CORPUS CONSTRUCTION FOR MACHINE LEARNING: «TAIGA» SYNTAX TREE CORPUS AND PARSER. in proc. of “CORPORA2017”, international conference , Saint-Petersbourg, 2017.
- Task
- Feature Extraction
- Library
- transformers
- Type
- bert
- Languages
- ru
- Hf Inference
- live
- Created
- Mar 2, 2022
- Updated
- Nov 8, 2021