Downloads · 30 days
3
0% of all-time downloads
pubchem_1M
rifkat/pubchem_1M
pubchem_1M is a fill-mask model from rifkat. Use it when you need the model to fill a missing word. It is set up for transformers.
Ushbu model, HuggingFace-da RoBERTa transformatorini amalga oshirishga asoslangan. Bizning RoBERTa dasturimiz 12 ta diqqat boshi va 6 ta qatlamdan foydalanadi, natijada 72 ta aniq e'tibor mexanizmlari paydo bo'ladi. B…
All-time downloads
8.6K
Public
Repo size
668 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin334 MB · 100%
At a glance
- Task
- Fill-Mask
- Library
- transformers
- Model type
- roberta
- Access
- Public
- Created
- Mar 2, 2022
- Updated
- Dec 7, 2022
- SHA
- 098049a2
Try a prompt
Model card
From the Hugging Face model README
Ushbu model, HuggingFace-da RoBERTa transformatorini amalga oshirishga asoslangan. Bizning RoBERTa dasturimiz 12 ta diqqat boshi va 6 ta qatlamdan foydalanadi, natijada 72 ta aniq e'tibor mexanizmlari paydo bo'ladi. Biz har bir kirish satridagi tokenlarning 15 foizini niqoblaydigan RoBERTa-dan dastlabki tekshirish protsedurasini qabul qildik. Biz maksimal 52K tokenli lug'atdan va maksimal 512 ta ketma-ketlik uzunligidan foydalanganmiz. Biz 1M PubChem to'plamlarida 10 ta davr uchun o'qitdik. Loss funksiya 2.9 dan 0.33 gacha tushdi. Ushbu modelni sizga taqdim qilamiz.
<pre><code class="language-python"> @misc {rifkat_davronov_2022, author = { {Adilova Fatima,Rifkat Davronov, Samariddin Kushmuratov, Ruzmat Safarov} }, title = { pubchem_1M (Revision 89e2ba6) }, year = 2022, url = { https://huggingface.co/rifkat/pubchem_1M }, doi = { 10.57967/hf/0177 }, publisher = { Hugging Face } } </code></pre>- Task
- Fill-Mask
- Library
- transformers
- Type
- roberta
- Created
- Mar 2, 2022
- Updated
- Dec 7, 2022