mT5-large-HuAMR

Model Card for mT5-large-HuAMR

<!-- Provide a quick summary of what the model is/does. -->

Model Details

Model Description

<!-- Provide a longer summary of what this model is. -->

This model is a fine-tuned version of google/mt5-large on the translated AMR 3.0 and HuAMR dataset. It achieves the following results on the evaluation set:

• Model type: Abstract Meaning Representation parser
• Language(s) (NLP): Hungarian

Model Sources [optional]

<!-- Provide the basic links for the model. -->

• Repository: GitHub Repo

Training Details

Training Procedure

<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->

Training Hyperparameters

• learning_rate: 5e-05
• train_batch_size: 1
• gradient_accumulation_steps: 16
• total_train_batch_size: 16
• optimizer: AdamW
• lr_scheduler_type: linear
• max_grad_norm: 0.3

Metrics

<!-- These are the evaluation metrics being used, ideally with a description of why. -->

[More Information Needed]

Citation [optional]

<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->

BibTeX:

[More Information Needed]

Framework versions

• Transformers 4.34.1
• Pytorch 2.3.0+cu118
• Datasets 2.19.0
• Tokenizers 0.19.1