Downloads · 30 days
0
CNVSRC2023Baseline
DataoceanAI/CNVSRC2023Baseline
CNVSRC2023Baseline is a machine learning model from DataoceanAI. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This repository provides the baseline model files for CNVSRC2023 (Chinese Continuous Visual Speech Recognition Challenge 2023).
Access
Public
Updated Sep 19, 2023
Repo size
4 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.pth4 GB · 100%
At a glance
- Access
- Public
- Created
- Aug 23, 2023
- Updated
- Sep 19, 2023
- SHA
- 4409bec9
Model card
From the Hugging Face model README
Introduction
This repository provides the baseline model files for CNVSRC2023 (Chinese Continuous Visual Speech Recognition Challenge 2023).
Usage
Please download these model files and use them in the baseline code.
Performance
The following table shows these models' performance on their own tasks.
| Training Data | Task | CER | File Name |
|---|---|---|---|
| CN-CVS (<4s) | Pre-training | / | model_avg_14_23_cncvs_4s.pth |
| CN-CVS (full) | Pre-training | / | model_avg_last10_cncvs_4s_30s.pth |
| CN-CVS + CNVSRC-Single.Dev | Single-speaker VSR (T1) | 48.60% | model_avg_last5_cncvs_cnvsrc-single.pth |
| CN-CVS + CNVSRC-Multi.Dev | Multi-speaker VSR (T2) | 58.37% | model_avg_last5_cncvs_cnvsrc-multi.pth |
- Created
- Aug 23, 2023
- Updated
- Sep 19, 2023