Downloads · 30 days
12
26% of all-time downloads
onnx-community/wav2vec2-base-10k-voxpopuli-ft-en-ONNX
wav2vec2-base-10k-voxpopuli-ft-en-ONNX is a automatic speech recognition model from onnx-community. Use it when you need speech turned into text. It is set up for transformers.js. The card lists the license as cc-by-nc-4.0.
This is an ONNX version of facebook/wav2vec2-base-10k-voxpopuli-ft-en. It was automatically converted and uploaded using this Hugging Face Space.
Downloads · 30 days
12
26% of all-time downloads
All-time downloads
46
Public
Repo size
807 MB
Likes
0
Public
Click a slice to open those files.
.onnx807 MB · 100%
From the Hugging Face model README
This is an ONNX version of facebook/wav2vec2-base-10k-voxpopuli-ft-en. It was automatically converted and uploaded using this Hugging Face Space.
See the pipeline documentation for automatic-speech-recognition: https://huggingface.co/docs/transformers.js/api/pipelines#module_pipelines.AutomaticSpeechRecognitionPipeline
Facebook's Wav2Vec2 base model pretrained on the 10K unlabeled subset of VoxPopuli corpus and fine-tuned on the transcribed data in en (refer to Table 1 of paper for more information).
Authors: Changhan Wang, Morgane Riviere, Ann Lee, Anne Wu, Chaitanya Talnikar, Daniel Haziza, Mary Williamson, Juan Pino, Emmanuel Dupoux from Facebook AI
See the official website for more information, here
In the following it is shown how the model can be used in inference on a sample of the Common Voice dataset
#!/usr/bin/env python3
from transformers import Wav2Vec2Processor, Wav2Vec2ForCTC
from datasets import load_dataset
import torchaudio
import torch
# resample audio
# load model & processor
model = Wav2Vec2ForCTC.from_pretrained("facebook/wav2vec2-base-10k-voxpopuli-ft-en")
processor = Wav2Vec2Processor.from_pretrained("facebook/wav2vec2-base-10k-voxpopuli-ft-en")
# load dataset
ds = load_dataset("common_voice", "en", split="validation[:1%]")
# common voice does not match target sampling rate
common_voice_sample_rate = 48000
target_sample_rate = 16000
resampler = torchaudio.transforms.Resample(common_voice_sample_rate, target_sample_rate)
# define mapping fn to read in sound file and resample
def map_to_array(batch):
speech, _ = torchaudio.load(batch["path"])
speech = resampler(speech)
batch["speech"] = speech[0]
return batch
# load all audio files
ds = ds.map(map_to_array)
# run inference on the first 5 data samples
inputs = processor(ds[:5]["speech"], sampling_rate=target_sample_rate, return_tensors="pt", padding=True)
# inference
logits = model(**inputs).logits
predicted_ids = torch.argmax(logits, axis=-1)
print(processor.batch_decode(predicted_ids))