cc_narratives_robertamodel3

<!-- This model card has been generated automatically according to the information the Trainer had access to. You should probably proofread and complete it, then remove this comment. -->

cc_narratives_robertamodel3

This model is a fine-tuned version of nnisbett/cc-narratives_robertamodel2 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1325
• F1: 0.8278

Model description

This model classifies climate-related sentences into either normative, delay, or economic based on the argument they express.

Intended uses & limitations

More information needed

Training and evaluation data

This model was trained on transcripts of interviews with UK members of parliament.

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 16
• eval_batch_size: 16
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Framework versions

• Transformers 4.28.0
• Pytorch 2.0.1+cu118
• Datasets 2.14.5
• Tokenizers 0.13.3