Downloads · 30 days
31
6% of all-time downloads
osiria/minilm-l12-h384-italian-cased
minilm-l12-h384-italian-cased is a fill-mask model from osiria. Use it when you need the model to fill a missing word. It is set up for transformers. The card lists the license as mit.
--------------------------------------------------------------------------------------------------
Downloads · 30 days
31
6% of all-time downloads
All-time downloads
489
Public
Parameters
33.4M
267 MB on disk
Likes
0
Public
Click a slice to open those files.
.bin134 MB · 50%
From the Hugging Face model README
This is a <b>MiniLMv2</b> <b>[1]</b> model for the <b>Italian</b> language, obtained using <b>mMiniLMv2</b> (L12xH384 mMiniLMv2) as a starting point and focusing it on the Italian language by modifying the embedding layer (as in <b>[2]</b>, computing document-level frequencies over the <b>Wikipedia</b> dataset)
The resulting model has 33M parameters, a vocabulary of 30.498 tokens, and a size of ~130 MB.
<h3>References</h3>[1] https://arxiv.org/abs/2012.15828
[2] https://arxiv.org/abs/2010.05609
<h3>License</h3>The model is released under <b>MIT</b> license