Downloads · 30 days
21
2% of all-time downloads
esm2_t6_long
gabrielbianchin/esm2_t6_long
esm2_t6_long is a fill-mask model from gabrielbianchin. Use it when you need the model to fill a missing word. It is set up for transformers.
ESM2 Long is an adapted version of the ESM2 architectures. It uses local attention instead of global attention, allowing for models with longer input sizes. ESM2 Long models have a context size of 2,050, double that o…
All-time downloads
1.1K
Public
Repo size
80.2 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin40.1 MB · 100%
At a glance
- Task
- Fill-Mask
- Library
- transformers
- Model type
- esm
- Access
- Public
- Created
- Dec 26, 2023
- Updated
- Aug 26, 2024
- SHA
- d7876926
Try a prompt
Model card
From the Hugging Face model README
ESM2 Long
ESM2 Long is an adapted version of the ESM2 architectures. It uses local attention instead of global attention, allowing for models with longer input sizes. ESM2 Long models have a context size of 2,050, double that of the standard ESM2 model. Several ESM2 Long models are available:
| Model | Num layers |
|---|---|
| gabrielbianchin/esm2_t33_long | 33 |
| gabrielbianchin/esm2_t30_long | 30 |
| gabrielbianchin/esm2_t12_long | 12 |
| gabrielbianchin/esm2_t6_long | 6 |
For detailed information, please refer to the paper.
- Task
- Fill-Mask
- Library
- transformers
- Type
- esm
- Created
- Dec 26, 2023
- Updated
- Aug 26, 2024