Downloads · 30 days
6
14% of all-time downloads
AmelieSchreiber/esm2_t6_8M_UR50D_lora_rna_binding_sites
esm2_t6_8M_UR50D_lora_rna_binding_sites is a machine learning model from AmelieSchreiber. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft.
This is an attempt to use Parameter Efficient Fine Tuning (PEFT) with Low Rank Adaptation (LoRA) for the ESM-2 model esm2t68MUR50D. The Github can be found here. The model is intended to serve as an
Downloads · 30 days
6
14% of all-time downloads
All-time downloads
42
Public
Repo size
32.6 MB
Likes
0
Public
Click a slice to open those files.
.bin32.6 MB · 100%
From the Hugging Face model README
This is an attempt to use Parameter Efficient Fine Tuning (PEFT) with Low Rank Adaptation (LoRA) for the ESM-2 model esm2_t6_8M_UR50D. The Github can be found here. The model is intended to serve as an RNA binding site predictor for protein sequences. However, there seems to be something going wrong either during training, or at inference, as the model seems to only predict non-binding sites. The problem is likely in the training setup. Any feedback, comments, or discussion would be greatly appreciated.