Downloads · 30 days
13
48% of all-time downloads
s-haturusinghe/mrp_0.5_seed42_b16_e5_radam_s42_msk0.5_ep3
mrp_0.5_seed42_b16_e5_radam_s42_msk0.5_ep3 is a machine learning model from s-haturusinghe. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Downloads · 30 days
13
48% of all-time downloads
All-time downloads
27
Public
Parameters
278M
2.2 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors1.1 GB · 100%
From the Hugging Face model README
Base Model: xlm-roberta-base
Intermediate Task: mrp-
Pre-Finetuned Model: None
Wandb Run URL: https://wandb.ai/s_haturusinghe-university-of-kelaniya/xlmr-base-stage1-42-b16-e5-radam-s42-mrp-msk0.5/runs/j19zo0fd
Epochs: 3
Steps: 410
Validation Time: 0.01s
Validation Loss: 0.145386
Validation Accuracy: 0.939030
Validation F1: 0.573137
{'0': {'precision': 0.9450254056712014, 'recall': 0.9928364788538366, 'f1-score': 0.9683411430778791, 'support': 29036.0}, '1': {'precision': 0.49514563106796117, 'recall': 0.10845295055821372, 'f1-score': 0.17793283907544702, 'support': 1881.0}, 'accuracy': 0.9390303069508684, 'macro avg': {'precision': 0.7200855183695813, 'recall': 0.5506447147060252, 'f1-score': 0.573136991076663, 'support': 30917.0}, 'weighted avg': {'precision': 0.9176545787465744, 'recall': 0.9390303069508684, 'f1-score': 0.9202524533657928, 'support': 30917.0}}
Masked Accuracy: 0.947170
Masked F1: 0.756160
{'0': {'precision': 0.9648361189494248, 'recall': 0.9792186811572918, 'f1-score': 0.9719741973103976, 'support': 13618.0}, '1': {'precision': 0.6149659863945578, 'recall': 0.48187633262260127, 'f1-score': 0.5403466826060969, 'support': 938.0}, 'accuracy': 0.9471695520747458, 'macro avg': {'precision': 0.7899010526719913, 'recall': 0.7305475068899465, 'f1-score': 0.7561604399582472, 'support': 14556.0}, 'weighted avg': {'precision': 0.9422902145569774, 'recall': 0.9471695520747458, 'f1-score': 0.9441597834059847, 'support': 14556.0}}
"learning_rate": 2e-05
"epochs": 5
"batch_size": 16
"model": xlm-roberta-base
"intermediate_task": mrp
"n_tk_label": 2
"mask_ratio": 0.5
"seed": 42
"dataset": sold
"finetuning_stage": pre
"val_int": 10000
"patience": 3
"skip_empty_rat": True