Downloads · 30 days
0
Eval-01
Mr-FineTuner/Eval-01
Eval-01 is a machine learning model from Mr-FineTuner. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This repository contains two logistic regression models trained to predict sentiment scores.
Access
Public
Updated Mar 8, 2025
Repo size
100 KB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.joblib100 KB · 92%
At a glance
- Access
- Public
- Created
- Mar 8, 2025
- Updated
- Mar 8, 2025
- SHA
- 6dbf09fd
Model card
From the Hugging Face model README
Sentiment Analysis Models
This repository contains two logistic regression models trained to predict sentiment scores.
Model Details
- Base embedding model: BAAI/bge-large-en-v1.5
- Architecture: LogisticRegression (scikit-learn)
- Training data: Custom sentiment dataset with dual expert annotations
- Data split: 70% training, 15% development, 15% test
Performance Metrics
Development Set
Against Expert 1:
- Exact match: 50.95%
- Within 1 level: 95.17%
Against Expert 2:
- Exact match: 37.92%
- Within 1 level: 92.31%
Test Set
Against Expert 1:
- Exact match: 50.21%
- Within 1 level: 95.27%
Against Expert 2:
- Exact match: 41.23%
- Within 1 level: 92.26%
Usage
See inference.py for an example of how to use these models to predict sentiment for new text.
Model Files
model1.joblib: Model trained on Expert 1 annotationsmodel2.joblib: Model trained on Expert 2 annotations
Data Files
dev_results.csv: Complete predictions on development settest_results.csv: Complete predictions on test set
- Created
- Mar 8, 2025
- Updated
- Mar 8, 2025