Downloads · 30 days
4
1% of all-time downloads
nova-threat-analyzer-swe
Arro94/nova-threat-analyzer-swe
nova-threat-analyzer-swe is a text classification model from Arro94. Use it when you need a label for a piece of text. It is set up for transformers. The card lists the license as gpl-3.0.
Trained on 6040 posts (39% threats, 61% non-threats); variying from authentic Swedish text and translated English texts (synthetic and authentic).
All-time downloads
670
Public
Repo size
998 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin499 MB · 100%
At a glance
- Task
- Text Classification
- Library
- transformers
- License
- gpl-3.0
- Model type
- bert
- Access
- Public
- Created
- May 5, 2023
- Updated
- Aug 28, 2024
- SHA
- 0f18736d
Model card
From the Hugging Face model README
Trained on 6040 posts (39% threats, 61% non-threats); variying from authentic Swedish text and translated English texts (synthetic and authentic).
Feel free to contact us and provide feedback, as we will try to iteratively improve the model with time. Reach out via: [email protected] or via inbox.
Trained using:
- Batch Size: 16
- Learning Rate: 2e-5
- Epochs: 2
- Max Sequence Length: 45
- Epsilon: 1e-8
- Warmup Steps: 226
- Optimizer: adamw_torch
Average performance based on all three tests
Average Accuracy: 0.87
| Label | Precision | Recall | F1 Score |
|---|---|---|---|
| 0 (Non-Threat) | 0.96 | 0.86 | 0.90 |
| 1 (Threat) | 0.67 | 0.89 | 0.76 |
| Macro | 0.81 | 0.89 | 0.83 |
| Weighted | 0.90 | 0.87 | 0.87 |
Performance for each test
| Test | Label | Precision | Recall | F1 Score |
|---|---|---|---|---|
| Test Set | 0 (Non-Threat) | 0.91 | 0.93 | 0.92 |
| Test Set | 1 (Threat) | 0.88 | 0.85 | 0.86 |
| Test Set | Macro Avg | 0.89 | 0.89 | 0.89 |
| Test Set | Weighted Avg | 0.90 | 0.90 | 0.90 |
| - | - | - | - | - |
| In-the-Wild 1 | 0 (Non-Threat) | 0.99 | 0.77 | 0.86 |
| In-the-Wild 1 | 1 (Threat) | 0.60 | 0.97 | 0.74 |
| In-the-Wild 1 | Macro Avg | 0.79 | 0.87 | 0.80 |
| In-the-Wild 1 | Weighted Avg | 0.88 | 0.82 | 0.83 |
| - | - | - | - | - |
| In-the-Wild 2 | 0 (Non-Threat) | 0.99 | 0.88 | 0.93 |
| In-the-Wild 2 | 1 (Threat) | 0.53 | 0.94 | 0.68 |
| In-the-Wild 2 | Macro Avg | 0.76 | 0.91 | 0.80 |
| In-the-Wild 2 | Weighted Avg | 0.93 | 0.89 | 0.90 |
| Accuracy | |
|---|---|
| Test Set | 0.90 |
| In-the-Wild 1 | 0.82 |
| In-the-Wild 2 | 0.89 |
- Task
- Text Classification
- Library
- transformers
- Type
- bert
- License
- gpl-3.0
- Languages
- sv
- Created
- May 5, 2023
- Updated
- Aug 28, 2024