Downloads · 30 days
16
10% of all-time downloads
esm2_t6_8M_finetuned_cafa5_v2
AmelieSchreiber/esm2_t6_8M_finetuned_cafa5_v2
esm2_t6_8M_finetuned_cafa5_v2 is a text classification model from AmelieSchreiber. Use it when you need a label for a piece of text. It is set up for transformers. The card lists the license as mit.
This model is a pre-finetuned for CAFA-5 protein function prediction for four epochs. This model is meant to be finetuned in a second stage of training with a Low Rank Adaptation. The training script for both the pre-…
All-time downloads
158
Public
Repo size
62.8 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin31.4 MB · 100%
At a glance
- Task
- Text Classification
- Library
- transformers
- License
- mit
- Model type
- esm
- Access
- Public
- Created
- Aug 31, 2023
- Updated
- Aug 31, 2023
- SHA
- 8301fe61
Try a prompt
Model card
From the Hugging Face model README
ESM-2 Pre-finetuned for CAFA-5 for Protein Function Prediction
This model is a pre-finetuned for CAFA-5 protein function prediction for four epochs. This model is meant to be finetuned in a second stage of training with a Low Rank Adaptation. The training script for both the pre-finetuning and second stage finetuning with LoRA is available here. This notebook allows you to pre-finetune the base model, and then use a LoRA for the second stage of training. Note, the second stage of training is a harder curriculum for the model as it uses class weights so that the model better captures the hierarchical (weighted) structure of the gene ontology (GO) terms that serve as the labels for the multilabel sequence classification task of predicting a protein's functions (GO terms).
- Task
- Text Classification
- Library
- transformers
- Type
- esm
- License
- mit
- Languages
- en
- Created
- Aug 31, 2023
- Updated
- Aug 31, 2023