Downloads · 30 days
239
1% of all-time downloads
talkbank/CHATWhisper-en
CHATWhisper-en is a automatic speech recognition model from talkbank. Use it when you need speech turned into text. It is set up for transformers.
CHATWhisper is a series of ASR models specifically designed for the task for Language Sample Analysis (LSA) released by the TalkBank project, which delivers superior performance in the analysis of conversational speec…
Downloads · 30 days
239
1% of all-time downloads
All-time downloads
17.5K
Public
Repo size
12.3 GB
Likes
1
Public
Click a slice to open those files.
.bin6.2 GB · 100%
From the Hugging Face model README
CHATWhisper is a series of ASR models specifically designed for the task for Language Sample Analysis (LSA) released by the TalkBank project, which delivers superior performance in the analysis of conversational speech transcripts, especially with regards to the analysis of filled pauses, retraicings, and stuttering.
The models are based on openai/whisper-large-v2 trained using an alpha=32, rank=16 LoRA. We will update the model card with evaluation performance shortly.
The models can be used directly as a Whisper-class ASR model following the same instructions released by OpenAI. Alternatively, to get the full analysis possible with the model, it is best combined with the TalkBank Batchalign suite of analysis software, available here, using transcribe mode with the --whisper flag.
The models are trained with a combination of English Control Protocol samples from the AphasiaBank corpus of conversational speech from three seperate corpora.