Downloads · 30 days
0
CNVSRC2024Baseline
chenchen2121/CNVSRC2024Baseline
CNVSRC2024Baseline is a machine learning model from chenchen2121. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This repository provides the baseline model files for CNVSRC2024 (Chinese Continuous Visual Speech Recognition Challenge 2024).
Access
Public
Updated May 3, 2024
Repo size
4.5 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.pth4.5 GB · 100%
At a glance
- Access
- Public
- Created
- Apr 29, 2024
- Updated
- May 3, 2024
- SHA
- 3a2497de
Model card
From the Hugging Face model README
Introduction
This repository provides the baseline model files for CNVSRC2024 (Chinese Continuous Visual Speech Recognition Challenge 2024).
Usage
Please download these model files and use them in the baseline code.
Performance
The following table shows these models' performance on their own tasks.
| Training Data | Task | CER | File Name |
|---|---|---|---|
| CN-CVS (<4s) | Pre-training | / | model_avg_14_23_cncvs_4s.pth |
| CN-CVS (full) | Pre-training | / | model_avg_last10_cncvs_4s_30s.pth |
| CN-CVS + CNVSRC-Single.Dev | Single-speaker VSR (T1) | 39.66% | model_avg_last5_cncvs_cnvsrc-single.pth |
| CN-CVS + CNVSRC-Multi.Dev | Multi-speaker VSR (T2) | 52.20% | model_avg_last5_cncvs_cnvsrc-multi.pth |
- Created
- Apr 29, 2024
- Updated
- May 3, 2024