Downloads · 30 days
13
20% of all-time downloads
brineylab/BALM-shuffled
BALM-shuffled is a fill-mask model from brineylab. Use it when you need the model to fill a missing word. It is set up for transformers.
BALM-shuffled is an antibody language model that uses a RoBERTa architecture and was pre-trained on randomly shuffled paired antibody sequences from Jaffe et al. This was a control model used to evaluate the benefits…
Downloads · 30 days
13
20% of all-time downloads
All-time downloads
64
Public
Parameters
304M
1.2 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors1.2 GB · 100%
From the Hugging Face model README
BALM-shuffled is an antibody language model that uses a RoBERTa architecture and was pre-trained on randomly shuffled paired antibody sequences from Jaffe et al. This was a control model used to evaluate the benefits of natively paired sequences in our paper published in Patterns. Therefore, this model should not be used for real use cases; use BALM-paired instead.
Load the model and tokenizer as follows:
from transformers import RobertaTokenizer, RobertaForMaskedLM
model = RobertaForMaskedLM.from_pretrained("brineylab/BALM-shuffled")
tokenizer = RobertaTokenizer.from_pretrained("brineylab/BALM-shuffled")
The tokenizer expects sequences formatted as: HEAVY_CHAIN</s>LIGHT_CHAIN.