Downloads · 30 days
0
bert-mean-pooling-rte
gal-lardo/bert-mean-pooling-rte
bert-mean-pooling-rte is a machine learning model from gal-lardo. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This model is a fine-tuned BERT model that uses mean pooling instead of the CLS token for the Recognizing Textual Entailment (RTE) task.
Access
Public
Updated Apr 7, 2025
Repo size
876 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.pt876 MB · 100%
At a glance
- Access
- Public
- Created
- Apr 7, 2025
- Updated
- Apr 7, 2025
- SHA
- 353fa59b
Model card
From the Hugging Face model README
BERT Mean Pooling Classifier for RTE
This model is a fine-tuned BERT model that uses mean pooling instead of the CLS token for the Recognizing Textual Entailment (RTE) task.
Model description
Instead of using the conventional approach of taking the CLS token representation, this model computes the mean of all token representations in the sequence, weighted by the attention mask to handle padding properly.
Hyperparameters
- Learning rate: 1.1056980156506841e-05
- Number of epochs: 4
- Max sequence length: 64
- Dropout rate: 0.2
- Batch size: 32
Performance
- Accuracy: 0.5596
- Macro F1: 0.5516
- Precision: 0.5564
- Recall: 0.5540
- Created
- Apr 7, 2025
- Updated
- Apr 7, 2025