Downloads · 30 days
0
esm2-8m-protein-localization
rustambekurokov/esm2-8m-protein-localization
esm2-8m-protein-localization is a machine learning model from rustambekurokov. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
Fine-tuned ESM-2 8M for protein subcellular localization (10 classes). All ESM-2 layers frozen — only the classification head was trained.
Access
Public
Updated Jul 8, 2026
Repo size
30.2 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.pt30.2 MB · 100%
At a glance
- License
- mit
- Access
- Public
- Created
- Jul 8, 2026
- Updated
- Jul 8, 2026
- SHA
- 36036fb6
Base models
Datasets
Model card
From the Hugging Face model README
ESM-2 8M — Protein Subcellular Localization (Linear Probe)
Fine-tuned ESM-2 8M for protein subcellular localization (10 classes). All ESM-2 layers frozen — only the classification head was trained.
Results
| Metric | Score |
|---|---|
| Accuracy | 69.6% |
| F1 (macro) | 0.581 |
| F1 (weighted) | 0.686 |
| MCC | 0.614 |
Architecture
ESM-2 8M (frozen) → Mean pooling → LayerNorm → Linear(320→80) → GELU → Linear(80→10)
Training
- Dataset: DeepLoc 2.0 (17,266 train / 3,700 val / 3,701 test)
- Strategy: Linear probe (backbone frozen, head only)
- Epochs: 15
- Learning rate: 1e-3
- Hardware: NVIDIA DGX Spark
All Models in This Project
| Model | Strategy | Accuracy | Link |
|---|---|---|---|
| ESM-2 8M | Linear probe | 69.6% | This repo |
| ESM-2 35M | Full fine-tune | 74.3% | whiteh4t/esm2-35m-protein-localization |
| ESM-2 150M | Full fine-tune | 76.6% | whiteh4t/esm2-150m-protein-localization |
| ESM-2 650M | LoRA (r=16) | 76.5% | whiteh4t/esm2-650m-protein-localization-lora |
Links
- Demo: HuggingFace Space
- Code: GitHub
- License
- mit
- Languages
- en
- Created
- Jul 8, 2026
- Updated
- Jul 8, 2026