Downloads · 30 days
6
11% of all-time downloads
saraestevez/setfit-xlm-bank-tweets-processed-80
setfit-xlm-bank-tweets-processed-80 is a text classification model from saraestevez. Use it when you need a label for a piece of text. It is set up for setfit.
This is a SetFit model that can be used for Text Classification. This SetFit model uses FacebookAI/xlm-roberta-base as the Sentence Transformer embedding model. A LogisticRegression instance is used for classification.
Downloads · 30 days
6
11% of all-time downloads
All-time downloads
56
Public
Parameters
278M
1.1 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors1.1 GB · 98%
From the Hugging Face model README
This is a SetFit model that can be used for Text Classification. This SetFit model uses FacebookAI/xlm-roberta-base as the Sentence Transformer embedding model. A LogisticRegression instance is used for classification.
The model has been trained using an efficient few-shot learning technique that involves:
| Label | Examples |
|---|---|
| discard | <ul><li>'Las negociaciones para el Banco de España avanzan rápidamente y el Congreso convocará el jueves la comisión de economía para anunciar los nombres pactados, con Conthe como la candidata más firme a gobernadora.'</li><li>'Depósitos y seguros son aspectos fundamentales para atraer clientes y potenciar el negocio de Caixabank en la segunda mitad del año.'</li><li>'El Banco Santander ofrece 400€ al cambiar tu nómina a su cuenta en línea, eliminando las comisiones bancarias.'</li></ul> |
| relevant | <ul><li>'Nuevo caso de phishing relacionado con Evobanco registrado el 13 de julio de 2024.'</li><li>'El Banco Sabadell ofrece depósitos a plazo fijo con un interés del 2,5% TAE a 1 año y 3% TAE a 6 meses, lo cual es una buena opción.'</li><li>'Estoy en Abanca porque no me cobran comisiones, de lo contrario ya los habría dejado.'</li></ul> |
| Label | Accuracy |
|---|---|
| all | 0.7138 |
First install the SetFit library:
pip install setfit
Then you can load this model and run inference.
from setfit import SetFitModel
# Download from the 🤗 Hub
model = SetFitModel.from_pretrained("saraestevez/setfit-xlm-bank-tweets-processed-80")
# Run inference
preds = model("Banco Sabadell confirma el día de pago de pensiones para jubilados en agosto.")
<!--
### Downstream Use
*List how someone could finetune this model on their own dataset.*
-->
<!--
### Out-of-Scope Use
*List how the model may foreseeably be misused and address what users ought not to do with the model.*
-->
<!--
## Bias, Risks and Limitations
*What are the known or foreseeable issues stemming from this model? You could also flag here known failure cases or weaknesses of the model.*
-->
<!--
### Recommendations
*What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.*
-->
| Training set | Min | Median | Max |
|---|---|---|---|
| Word count | 1 | 21.0437 | 36 |
| Label | Training Sample Count |
|---|---|
| discard | 80 |
| relevant | 80 |
| Epoch | Step | Training Loss | Validation Loss |
|---|---|---|---|
| 0.0025 | 1 | 0.4924 | - |
| 0.125 | 50 | 0.2519 | - |
| 0.25 | 100 | 0.186 | - |
| 0.375 | 150 | 0.188 | - |
| 0.5 | 200 | 0.0504 | - |
| 0.625 | 250 | 0.0412 | - |
| 0.75 | 300 | 0.0147 | - |
| 0.875 | 350 | 0.0517 | - |
| 1.0 | 400 | 0.0162 | - |
@article{https://doi.org/10.48550/arxiv.2209.11055,
doi = {10.48550/ARXIV.2209.11055},
url = {https://arxiv.org/abs/2209.11055},
author = {Tunstall, Lewis and Reimers, Nils and Jo, Unso Eun Seo and Bates, Luke and Korat, Daniel and Wasserblat, Moshe and Pereg, Oren},
keywords = {Computation and Language (cs.CL), FOS: Computer and information sciences, FOS: Computer and information sciences},
title = {Efficient Few-Shot Learning Without Prompts},
publisher = {arXiv},
year = {2022},
copyright = {Creative Commons Attribution 4.0 International}
}
<!--
## Glossary
*Clearly define terms in order to be accessible across audiences.*
-->
<!--
## Model Card Authors
*Lists the people who create the model card, providing recognition and accountability for the detailed work that goes into its construction.*
-->
<!--
## Model Card Contact
*Provides a way for people who have updates to the Model Card, suggestions, or questions, to contact the Model Card authors.*
-->