medical_pubmed_8_19

DogGoesBark/medical_pubmed_8_19

medical_pubmed_8_19 is a machine learning model from DogGoesBark. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

13% of all-time downloads

All-time downloads

Public

Repo size

4.3 GB

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.bin310 MB · 99%

At a glance

Library: transformers
License: apache-2.0
Model type: marian
Access: Public
Created: Jul 19, 2023
Updated: Jul 19, 2023
SHA: 005a0426

Base models

Helsinki-NLP/opus-mt-en-es

Model card

From the Hugging Face model README

medical_pubmed_8_19

This model is a fine-tuned version of Helsinki-NLP/opus-mt-en-es on the None dataset. It achieves the following results on the evaluation set:

Loss: 0.4625
Bleu: 58.7452
Gen Len: 119.0251

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 8e-05
train_batch_size: 32
eval_batch_size: 32
seed: 42
gradient_accumulation_steps: 4
total_train_batch_size: 128
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 20

Training results

Training Loss	Epoch	Step	Validation Loss	Bleu	Gen Len
0.8785	3.25	1000	0.8319	47.8321	118.9146
0.6571	6.5	2000	0.7008	50.9386	118.9497
0.5257	9.76	3000	0.5956	53.6824	118.9724
0.4406	13.01	4000	0.5257	56.3775	119.0075
0.3834	16.26	5000	0.4808	57.9502	119.0302
0.3541	19.51	6000	0.4625	58.7452	119.0251

Framework versions

Transformers 4.31.0
Pytorch 2.0.1+cu118
Datasets 2.13.1
Tokenizers 0.13.3

Library: transformers
Type: marian
License: apache-2.0
Created: Jul 19, 2023
Updated: Jul 19, 2023