Downloads · 30 days
7
1% of all-time downloads
Trabis/Helsinki-NLPopus-mt-tc-big-en-moroccain_dialect
Helsinki-NLPopus-mt-tc-big-en-moroccain_dialect is a translation model from Trabis. Use it when you need text moved from one language to another. It is set up for transformers.
should probably proofread and complete it, then remove this comment. --
Downloads · 30 days
7
1% of all-time downloads
All-time downloads
755
Public
Repo size
7.7 GB
Likes
3
Public
Click a slice to open those files.
.bin957 MB · 100%
From the Hugging Face model README
This model was trained from scratch on the None dataset. It achieves the following results on the evaluation set:
MarianConfig { "_name_or_path": "/content/drive/MyDrive/Colab Notebooks/big_helsinki_eng_dar", "activation_dropout": 0.0, "activation_function": "relu", "architectures": [ "MarianMTModel" ], "attention_dropout": 0.0, "bad_words_ids": [ [ 61246 ] ], "bos_token_id": 0, "classifier_dropout": 0.0, "d_model": 1024, "decoder_attention_heads": 16, "decoder_ffn_dim": 4096, "decoder_layerdrop": 0.0, "decoder_layers": 6, "decoder_start_token_id": 61246, "decoder_vocab_size": 61247, "dropout": 0.1, "encoder_attention_heads": 16, "encoder_ffn_dim": 4096, "encoder_layerdrop": 0.0, "encoder_layers": 6, "eos_token_id": 25897, "forced_eos_token_id": 25897, "init_std": 0.02, "is_encoder_decoder": true, "max_length": 512, "max_position_embeddings": 1024, "model_type": "marian", "normalize_embedding": false, "num_beams": 4, "num_hidden_layers": 6, "pad_token_id": 61246, "scale_embedding": true, "share_encoder_decoder_embeddings": true, "static_position_embeddings": true, "torch_dtype": "float32", "transformers_version": "4.28.0", "use_cache": true, "vocab_size": 61247 }
More information needed
DatasetDict({ train: Dataset({ features: ['input_ids', 'attention_mask', 'labels'], num_rows: 15443 }) test: Dataset({ features: ['input_ids', 'attention_mask', 'labels'], num_rows: 813 }) })
Using transfer learning due to limited data in the Moroccan dialect.
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | Bleu | Gen Len |
|---|---|---|---|---|---|
| 0.617 | 1.0 | 1931 | 0.6930 | 50.0607 | 14.7048 |