Downloads · 30 days
0
Eval-02
Mr-FineTuner/Eval-02
Eval-02 is a machine learning model from Mr-FineTuner. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This repository contains two logistic regression models trained to predict sentiment scores.
Access
Public
Updated Mar 8, 2025
Repo size
38.7 KB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.joblib38.7 KB · 82%
At a glance
- Access
- Public
- Created
- Mar 8, 2025
- Updated
- Mar 8, 2025
- SHA
- 3cd10f47
Model card
From the Hugging Face model README
Sentiment Analysis Models
This repository contains two logistic regression models trained to predict sentiment scores.
Model Details
- Base embedding model: paraphrase-MiniLM-L6-v2
- Architecture: LogisticRegression (scikit-learn)
- Training data: Custom sentiment dataset with dual expert annotations
- Data split: 70% training, 15% development, 15% test
Performance Metrics
Development Set
Against Expert 1:
- Exact match: 48.32%
- Within 1 level: 93.70%
Against Expert 2:
- Exact match: 38.95%
- Within 1 level: 92.17%
Test Set
Against Expert 1:
- Exact match: 47.81%
- Within 1 level: 93.63%
Against Expert 2:
- Exact match: 40.75%
- Within 1 level: 92.05%
Usage
See inference.py for an example of how to use these models to predict sentiment for new text.
Model Files
model1.joblib: Model trained on Expert 1 annotationsmodel2.joblib: Model trained on Expert 2 annotations
Data Files
dev_results.csv: Complete predictions on development settest_results.csv: Complete predictions on test set
- Created
- Mar 8, 2025
- Updated
- Mar 8, 2025