Downloads · 30 days
107
22% of all-time downloads
brineylab/BALM-unpaired
BALM-unpaired is a fill-mask model from brineylab. Use it when you need the model to fill a missing word. It is set up for transformers. The card lists the license as mit.
BALM-unpaired is an antibody language model that uses a RoBERTa architecture and was pre-trained on unpaired antibody sequences from Jaffe et al. Datasets used for pre-training are available on Zenodo and code is avai…
Downloads · 30 days
107
22% of all-time downloads
All-time downloads
485
Public
Parameters
304M
1.2 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors1.2 GB · 100%
From the Hugging Face model README
BALM-unpaired is an antibody language model that uses a RoBERTa architecture and was pre-trained on unpaired antibody sequences from Jaffe et al. Datasets used for pre-training are available on Zenodo and code is available on GitHub. More details can be found in our paper published in Patterns.
Load the model and tokenizer as follows:
from transformers import RobertaTokenizer, RobertaForMaskedLM
model = RobertaForMaskedLM.from_pretrained("brineylab/BALM-unpaired")
tokenizer = RobertaTokenizer.from_pretrained("brineylab/BALM-unpaired")
The tokenizer expects unpaired sequences, either HEAVY_CHAIN or LIGHT_CHAIN.