Downloads · 30 days
15
1% of all-time downloads
AreejB/wav2vec2-xlsr-english-speech-emotion-recognition
wav2vec2-xlsr-english-speech-emotion-recognition is a audio classification model from AreejB. Use it for the audio classification task on the model card, and read the license before you ship it in a product. It is set up for transformers.
This model extracts emotions from audio recordings. It was trained on RAVDESS, a dataset containing English audio recordings. The model recognises six emotions: anger, disgust, fear, happiness, sadness and surprise.
Downloads · 30 days
15
1% of all-time downloads
All-time downloads
1.1K
Public
Repo size
5 GB
Likes
0
Public
Click a slice to open those files.
.pt2.5 GB · 66%
From the Hugging Face model README
This model extracts emotions from audio recordings. It was trained on RAVDESS, a dataset containing English audio recordings. The model recognises six emotions: anger, disgust, fear, happiness, sadness and surprise.
The model recreates the work of this Greek emotion extractor using a pre-trained Wav2Vec2 model to process the data.
Use the code below to get started with the model.
[More Information Needed]
The RAVDESS dataset was split into training, validation and test sets with 60, 20 and 20 splits, respectively.
The fine-tuning process was centred on four hyper-parameters:
Each experiment was repeated 10 times.
The set of hyper-parameters resulting in the best performance is: 4 batches, 4 GAS, 10 epochs and 1e-4 learning rate
The model was retrained on the combined train and validation sets using the best hyper-parameter set. The performance on the test set has an average Accuracy and F1 scores of 84.84% (SD 2 and 2.08, respectively)
We retained the model providing the highest performance over the 10 runs.
| Emotion | Accuracy | Precision | Recall | F1 |
|---|---|---|---|---|
| Anger | 96.55 | 87.50 | ||
| Disgust | 90.91 | 93.75 | ||
| Fear | 96.30 | 81.25 | ||
| Happiness | 93.10 | 84.38 | ||
| Sad | 81.58 | 96.88 | ||
| Surprise | 77.78 | 87.50 | ||
| Total | 88.54 | 89.37 | 88.54 | 88.62 |