Downloads · 30 days
0
APaul1/roberta-large-peft-ia3
roberta-large-peft-ia3 is a machine learning model from APaul1. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers, peft.
This model is a peft version of the roberta-large finetuned on the mrpc task of glue dataset
Downloads · 30 days
0
Access
Public
Updated Feb 7, 2024
Repo size
4.9 MB
Likes
0
Public
Click a slice to open those files.
.safetensors4.9 MB · 100%
From the Hugging Face model README
This model is a peft version of the roberta-large finetuned on the mrpc task of glue dataset
This model is finetuned on the mrpc task of Glue dataset which essentially compares two statements and decides and gets a label as to if they are equivalent or not. Dataset example is shown below

The model was tested on the testing set and gave an accuracy of 86.6% and F1 score of 90%
Similar fine tuning and evaluation can be done on the other tasks of the GLUE dataset by loading the correspodning config files or defining appropriate LORA config uing sample code :