Downloads · 30 days
8
1% of all-time downloads
GlassBERTa
mldmm/GlassBERTa
GlassBERTa is a fill-mask model from mldmm. Use it when you need the model to fill a missing word. It is set up for transformers. The card lists the license as mit.
Alloy Property Prediction is a task under the sub field of Alloy Material Science wherein Machine Learning has been applied rigorously. This is modeled as a Supervised Task wherein Alloy Composition is provided for th…
All-time downloads
880
Public
Repo size
2.1 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin345 MB · 100%
At a glance
- Task
- Fill-Mask
- Library
- transformers
- License
- mit
- Model type
- roberta
- Access
- Public
- Created
- Mar 2, 2022
- Updated
- Jun 18, 2021
- SHA
- 8e979a50
Try a prompt
Model card
From the Hugging Face model README
GlassBERTa
Language Modelling as Unsupervised Pre-Training for Glass Alloys
Abstract:
Alloy Property Prediction is a task under the sub field of Alloy Material Science wherein Machine Learning has been applied rigorously. This is modeled as a Supervised Task wherein Alloy Composition is provided for the Model to predict a desired property. Efficiency of tasks such as Alloy Property Prediction, Alloy Synthesis can be modeled additionally with an Unsupervised Pre-training Task. We describe the idea of Pre-training using Language Modelling kind of approach in terms of Alloy Compositions.We specifically inspect that random masking proposed in is not suitable for modelling Alloys. We further go on proposing two types of masking strategies that are used to train GlassBERTa to encompass the properties of an Alloy Composition. The results suggest that Pre-training is an important field of direction in this field of research for further improvement.
Authors:
Reshinth Adithyan, Aditya TS, Roakesh, Jothikrishna, Kalaiselvan Baskaran
Footnote:
Work done via MLDMM Lab
- Task
- Fill-Mask
- Library
- transformers
- Type
- roberta
- License
- mit
- Created
- Mar 2, 2022
- Updated
- Jun 18, 2021