Downloads · 30 days
0
self_iterative_v1_stance_iteration_1
iTroned/self_iterative_v1_stance_iteration_1
self_iterative_v1_stance_iteration_1 is a machine learning model from iTroned. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
should probably proofread and complete it, then remove this comment. --
Access
Public
Updated May 12, 2025
Parameters
110M
11 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors441 MB · 100%
At a glance
- Library
- transformers
- License
- apache-2.0
- Access
- Public
- Created
- May 11, 2025
- Updated
- May 12, 2025
- SHA
- 8ba146f8
Base models
Model card
From the Hugging Face model README
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->
<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/> <img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/> <img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/> <img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/> <img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/> <img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>
self_iterative_v1_stance_iteration_1
This model is a fine-tuned version of bert-base-uncased on an unknown dataset. It achieves the following results on the evaluation set:
- Loss: 2.9849
- Accuracy Stance: 0.7443
- F1 Macro Stance: 0.6254
- F1 Weighted Stance: 0.7385
- F1 Macro Total: 0.6254
- F1 Weighted Total: 0.7385
Model description
More information needed
Intended uses & limitations
More information needed
Training and evaluation data
More information needed
Training procedure
Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 6e-06
- train_batch_size: 4
- eval_batch_size: 4
- seed: 1337
- optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
- lr_scheduler_type: linear
- num_epochs: 30
Training results
| Training Loss | Epoch | Step | Validation Loss | Accuracy Stance | F1 Macro Stance | F1 Weighted Stance | F1 Macro Total | F1 Weighted Total |
|---|---|---|---|---|---|---|---|---|
| 0.5574 | 1.0 | 5735 | 1.7777 | 0.7410 | 0.5197 | 0.6958 | 0.5197 | 0.6958 |
| 0.4377 | 2.0 | 11470 | 2.4130 | 0.7377 | 0.5174 | 0.6929 | 0.5174 | 0.6929 |
| 0.3192 | 3.0 | 17205 | 1.8249 | 0.7508 | 0.5271 | 0.7056 | 0.5271 | 0.7056 |
| 0.2358 | 4.0 | 22940 | 2.8592 | 0.7377 | 0.5168 | 0.6922 | 0.5168 | 0.6922 |
| 0.1864 | 5.0 | 28675 | 2.5952 | 0.7508 | 0.5753 | 0.7255 | 0.5753 | 0.7255 |
| 0.131 | 6.0 | 34410 | 2.9849 | 0.7443 | 0.6254 | 0.7385 | 0.6254 | 0.7385 |
| 0.0759 | 7.0 | 40145 | 3.6544 | 0.7082 | 0.5761 | 0.6943 | 0.5761 | 0.6943 |
| 0.0828 | 8.0 | 45880 | 3.6274 | 0.7213 | 0.6175 | 0.7188 | 0.6175 | 0.7188 |
| 0.0751 | 9.0 | 51615 | 3.8288 | 0.7213 | 0.6121 | 0.7128 | 0.6121 | 0.7128 |
| 0.06 | 10.0 | 57350 | 4.2269 | 0.7377 | 0.5539 | 0.7129 | 0.5539 | 0.7129 |
| 0.0348 | 11.0 | 63085 | 4.5192 | 0.7443 | 0.5828 | 0.7211 | 0.5828 | 0.7211 |
Framework versions
- Transformers 4.50.2
- Pytorch 2.6.0+cu124
- Datasets 3.0.1
- Tokenizers 0.21.1
- Library
- transformers
- License
- apache-2.0
- Created
- May 11, 2025
- Updated
- May 12, 2025