Downloads · 30 days
12
1% of all-time downloads
wav2vec2-base-100h-2nd-try
patrickvonplaten/wav2vec2-base-100h-2nd-try
wav2vec2-base-100h-2nd-try is a automatic speech recognition model from patrickvonplaten. Use it when you need speech turned into text. It is set up for transformers. The card lists the license as apache-2.0.
Second fine-tuning try of wav2vec2-base. Results are similar to the ones reported in https://huggingface.co/facebook/wav2vec2-base-100h.
All-time downloads
1.1K
Public
Repo size
755 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin378 MB · 100%
At a glance
- Task
- Automatic Speech Recognition
- Library
- transformers
- License
- apache-2.0
- Model type
- wav2vec2
- Access
- Public
- Created
- Mar 2, 2022
- Updated
- Nov 4, 2021
- SHA
- 7f9ffca9
Datasets
Model card
From the Hugging Face model README
Second fine-tuning try of wav2vec2-base. Results are similar to the ones reported in https://huggingface.co/facebook/wav2vec2-base-100h.
Model was trained on librispeech-clean-train.100 with following hyper-parameters:
- 2 GPUs Titan RTX
- Total update steps 11000
- Batch size per GPU: 32 corresponding to a total batch size of ca. ~750 seconds
- Adam with linear decaying learning rate with 3000 warmup steps
- dynamic padding for batch
- fp16
- attention_mask was not used during training
Check: https://wandb.ai/patrickvonplaten/huggingface/runs/1yrpescx?workspace=user-patrickvonplaten
Result (WER) on Librispeech:
| "clean" (% rel difference to results in paper) | "other" (% rel difference to results in paper) |
|---|---|
| 6.2 (-1.6%) | 15.2 (-11.2%) |
- Task
- Automatic Speech Recognition
- Library
- transformers
- Type
- wav2vec2
- License
- apache-2.0
- Languages
- en
- Created
- Mar 2, 2022
- Updated
- Nov 4, 2021