Downloads · 30 days
14
15% of all-time downloads
BALM-MoE
brineylab/BALM-MoE
BALM-MoE is a machine learning model from brineylab. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for custom. The card lists the license as mit.
BALM-MoE is a sparse mixture-of-experts antibody language model pre-trained on a mixture of paired and unpaired antibody sequences. It uses a Top-2 MoE architecture with 200M active parameters. Code is available on Gi…
All-time downloads
93
Public
Parameters
714M
2.9 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors2.9 GB · 100%
At a glance
- Library
- custom
- License
- mit
- Model type
- balm_moe
- Access
- Public
- Created
- Apr 3, 2026
- Updated
- Apr 3, 2026
- SHA
- 51842e69
Model card
From the Hugging Face model README
BALM-MoE
BALM-MoE is a sparse mixture-of-experts antibody language model pre-trained on a mixture of paired and unpaired antibody sequences. It uses a Top-2 MoE architecture with 200M active parameters. Code is available on GitHub. More details can be found in our paper published in the ICLR 2026 FM4Science Workshop.
Installation
BALM-MoE uses a custom architecture and requires the BALM package:
pip install git+https://github.com/brineylab/BALM.git
Use
Load the model and tokenizer as follows:
from balm import BalmMoEForMaskedLM, BalmTokenizer
model = BalmMoEForMaskedLM.from_pretrained("brineylab/BALM-MoE")
tokenizer = BalmTokenizer.from_pretrained("brineylab/BALM-MoE")
- Library
- custom
- Type
- balm_moe
- License
- mit
- Created
- Apr 3, 2026
- Updated
- Apr 3, 2026