Downloads · 30 days
5
3% of all-time downloads
alejandralopezsosa/gLM2_150M-promoter_tata-lora
gLM2_150M-promoter_tata-lora is a machine learning model from alejandralopezsosa. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft.
This model demonstrates the use of gLM2150M embeddings for downstream classification. The model is fine-tuned using LoRA and obtains an F1 score of 98.11% on the TATA promoter task from the Nucleotide Transformer benc…
Downloads · 30 days
5
3% of all-time downloads
All-time downloads
190
Public
Repo size
4.9 MB
Likes
0
Public
Click a slice to open those files.
.safetensors4.9 MB · 100%
From the Hugging Face model README
This model demonstrates the use of gLM2_150M embeddings for downstream classification. The model is fine-tuned using LoRA and obtains an F1 score of 98.11% on the TATA promoter task from the Nucleotide Transformer benchmarks.
Use the code below to use the model for inference:
from peft import PeftModel
from transformers import AutoConfig, AutoModelForSequenceClassification, AutoModel
glm2 = "tattabio/gLM2_150M"
adapter = "alejandralopezsosa/gLM2_150M-promoter_tata-lora"
load_kwargs = {
'trust_remote_code': True,
'torch_dtype': torch.bfloat16,
}
config = AutoConfig.from_pretrained(adapter, **load_kwargs)
base_model = AutoModelForSequenceClassification.from_config(config, **load_kwargs)
base_model.glm2 = AutoModel.from_pretrained("tattabio/gLM2_150M", **load_kwargs)
model = PeftModel.from_pretrained(base_model, adapter)