bel_canto

Intro

The Classical and Ethnic Vocal Style Classification model aims to distinguish between classical and ethnic vocal styles, with all audio samples sung by professional vocalists. The model is fine-tuned using an audio dataset consisting of four categories, which has been pre-processed into spectrograms. Initially pretrained in the computer vision (CV) domain, the backbone network undergoes a fine-tuning process specifically designed for vocal style classification tasks. In this model, the pre-training on CV tasks provides a foundation for the network to learn general audio features, which are then adjusted during fine-tuning to adapt to the subtle differences between classical and ethnic vocal styles. The audio dataset, comprising samples from classical and various ethnic singing traditions, enables the model to capture unique patterns associated with each vocal style. Representing spectrograms as input allows the model to effectively analyze both the temporal and frequency components of the audio signals. Through the fine-tuning process, the model continuously enhances its ability to discriminate between sound representations and subtle stylistic differences between classical and ethnic styles. This specialized model holds significant potential in the music industry and cultural preservation, as it accurately categorizes vocal performances into these two broad categories. Its foundation in pre-trained computer vision principles demonstrates the versatility and adaptability of neural networks across different domains, enhancing the model's capability to capture complex features of vocal performances.

Demo (inference code)

https://huggingface.co/spaces/ccmusic-database/bel_canto

Usage

from huggingface_hub import snapshot_download

model_dir = snapshot_download(
    "ccmusic-database/bel_canto",
    cache_dir="./__pycache__",
)
print(model_dir)

Maintenance

GIT_LFS_SKIP_SMUDGE=1 git clone [email protected]:ccmusic-database/bel_canto
cd bel_canto

Results

Best Result

<style> #bel td { vertical-align: middle !important; text-align: center; } #bel th { text-align: center; } </style> <table id="bel"> <tr> <th>Loss curve</th> <td><img src="https://www.modelscope.cn/models/ccmusic-database/bel_canto/resolve/master/googlenet_mel_2024-07-30_00-51-26/loss.jpg"></td> </tr> <tr> <th>Training and validation accuracy</th> <td><img src="https://www.modelscope.cn/models/ccmusic-database/bel_canto/resolve/master/googlenet_mel_2024-07-30_00-51-26/acc.jpg"></td> </tr> <tr> <th>Confusion matrix</th> <td><img src="https://www.modelscope.cn/models/ccmusic-database/bel_canto/resolve/master/googlenet_mel_2024-07-30_00-51-26/mat.jpg"></td> </tr> </table>

Dataset

https://huggingface.co/datasets/ccmusic-database/bel_canto

Mirror

https://www.modelscope.cn/models/ccmusic-database/bel_canto

Evaluation

https://github.com/monetjoe/ccmusic_eval

Cite

@article{Zhou-2025,
  author  = {Monan Zhou and Shenyang Xu and Zhaorui Liu and Zhaowen Wang and Feng Yu and Wei Li and Baoqiang Han},
  title   = {CCMusic: An Open and Diverse Database for Chinese Music Information Retrieval Research},
  journal = {Transactions of the International Society for Music Information Retrieval},
  volume  = {8},
  number  = {1},
  pages   = {22--38},
  month   = {Mar},
  year    = {2025},
  url     = {https://doi.org/10.5334/tismir.194},
  doi     = {10.5334/tismir.194}
}