Downloads · 30 days
71.5K
0% of all-time downloads
esm2_t36_3B_UR50D
facebook/esm2_t36_3B_UR50D
esm2_t36_3B_UR50D is a fill-mask model from facebook. Use it when you need the model to fill a missing word. It is set up for transformers. The card lists the license as mit.
ESM-2 is a state-of-the-art protein model trained on a masked language modelling objective. It is suitable for fine-tuning on a wide range of tasks that take protein sequences as input. For detailed information on the…
All-time downloads
42.3M
Public
Repo size
59.6 GB
Likes
37
Trending 2
Repo makeup
Click a slice to open those files.
.bin11.4 GB · 50%
At a glance
- Task
- Fill-Mask
- Library
- transformers
- License
- mit
- Model type
- esm
- Access
- Public
- Created
- Oct 13, 2022
- Updated
- Dec 1, 2022
- SHA
- 476b6399
Try a prompt
Model card
From the Hugging Face model README
ESM-2
ESM-2 is a state-of-the-art protein model trained on a masked language modelling objective. It is suitable for fine-tuning on a wide range of tasks that take protein sequences as input. For detailed information on the model architecture and training data, please refer to the accompanying paper. You may also be interested in some demo notebooks (PyTorch, TensorFlow) which demonstrate how to fine-tune ESM-2 models on your tasks of interest.
Several ESM-2 checkpoints are available in the Hub with varying sizes. Larger sizes generally have somewhat better accuracy, but require much more memory and time to train:
| Checkpoint name | Num layers | Num parameters |
|---|---|---|
| esm2_t48_15B_UR50D | 48 | 15B |
| esm2_t36_3B_UR50D | 36 | 3B |
| esm2_t33_650M_UR50D | 33 | 650M |
| esm2_t30_150M_UR50D | 30 | 150M |
| esm2_t12_35M_UR50D | 12 | 35M |
| esm2_t6_8M_UR50D | 6 | 8M |
- Task
- Fill-Mask
- Library
- transformers
- Type
- esm
- License
- mit
- Created
- Oct 13, 2022
- Updated
- Dec 1, 2022