out

<!-- This model card has been generated automatically according to the information the Trainer had access to. You should probably proofread and complete it, then remove this comment. -->

Model checkpoint for Assignment3

The full code for training procedure, configuration and the training log for the checkpoint model are documented in the IPython notebook accessible in the files

Comparable results of the checkpoint used in assignment3 can be reproduced in Colab using training pipeline in the IPython notebook.

This model is a fine-tuned version of microsoft/deberta-v3-base on climate claim verification training dataset(using gold evidence provided by the training set). It achieves the following results on the development set:

Model evalutaion performance on the development set

• F1: 0.7196
• Accuracy: 0.7922

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 1.5e-05
• train_batch_size: 4
• eval_batch_size: 4
• seed: 42
• gradient_accumulation_steps: 4
• total_train_batch_size: 16
• optimizer: Use OptimizerNames.ADAMW_TORCH_FUSED with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
• lr_scheduler_type: cosine
• lr_scheduler_warmup_steps: 0.1
• num_epochs: 10

Training results

Framework versions

• Transformers 5.8.0
• Pytorch 2.10.0+cu128
• Datasets 4.8.5
• Tokenizers 0.22.2