unphonemizer-gpt2

Model Card for unphonemizer-gpt2

This model was pretrained on a phonemized dataset from distil-whisper/whisper_transcriptions using the GPT-2 architecture to un-phonemize the phonemes.

Model Details

Model Description

<!-- Provide a longer summary of what this model is. -->

This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.

• Developed by: [More Information Needed]
• Funded by [optional]: [More Information Needed]
• Shared by [optional]: [More Information Needed]
• Model type: [More Information Needed]
• Language(s) (NLP): [More Information Needed]
• License: [More Information Needed]

Uses

Direct Use

Translates a sequence of phonemes into english text.

How to Get Started with the Model

To use the model, input the <s> token, than the phonemized text, than the seperator |. The model will then predict the english text following the '|' seperator. For example, to un-phonemize ˈeɪthˈʌndɹɪd nˈaɪnti sˈɪks (896), input to the model <s>ˈeɪthˈʌndɹɪd nˈaɪnti sˈɪks| and it will predict 896 following the '|'

Use the code below to get started with the model.

Training Details

Training Data

<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->

[More Information Needed]

Training Procedure

GPT-2 architecture was trained directly on the data from the dataset. A custom loss function was used to only train the model on the english side; no loss is added for how it predicts the phonemes.

Preprocessing [optional]

[More Information Needed]

Training Hyperparameters

• Training regime: [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->

Speeds, Sizes, Times [optional]

<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->

[More Information Needed]

Evaluation

<!-- This section describes the evaluation protocols and provides the results. -->

Testing Data, Factors & Metrics

Testing Data

<!-- This should link to a Dataset Card if possible. -->

[More Information Needed]

Factors

<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->

[More Information Needed]

Metrics

<!-- These are the evaluation metrics being used, ideally with a description of why. -->

[More Information Needed]

Results

[More Information Needed]

Summary

[More Information Needed]

Citation [optional]

<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->

BibTeX:

[More Information Needed]

APA:

[More Information Needed]