Downloads · 30 days
2.1K
23% of all-time downloads
ssast-small-patch-audioset-16-16
Simon-Kotchou/ssast-small-patch-audioset-16-16
ssast-small-patch-audioset-16-16 is a audio classification model from Simon-Kotchou. Use it for the audio classification task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as bsd-3-clause.
Self Supervised Audio Spectrogram Transformer (SSAST) model with uninitialized classifier head. It was introduced in the paper SSAST: Self-Supervised Audio Spectrogram Transformer by Gong et al. and first released in…
All-time downloads
8.8K
Public
Parameters
21.8M
174 MB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors87.2 MB · 100%
At a glance
- Task
- Audio Classification
- Library
- transformers
- License
- bsd-3-clause
- Model type
- audio-spectrogram-transformer
- Access
- Public
- Created
- Jan 10, 2024
- Updated
- Jul 4, 2024
- SHA
- 5c58230a
Model card
From the Hugging Face model README
Self Supervised Audio Spectrogram Transformer (pretrained on AudioSet/Librispeech)
Self Supervised Audio Spectrogram Transformer (SSAST) model with uninitialized classifier head. It was introduced in the paper SSAST: Self-Supervised Audio Spectrogram Transformer by Gong et al. and first released in this repository.
Disclaimer: The team releasing Audio Spectrogram Transformer did not write a model card for this model.
Model description
The Audio Spectrogram Transformer is equivalent to ViT, but applied on audio. Audio is first turned into an image (as a spectrogram), after which a Vision Transformer is applied. The model gets state-of-the-art results on several audio classification benchmarks.
Usage
The model is pretrained on a massive amount of audio. Please finetune the classifier head before use, as it comes uninitialized.
- Task
- Audio Classification
- Library
- transformers
- Type
- audio-spectrogram-transformer
- License
- bsd-3-clause
- Created
- Jan 10, 2024
- Updated
- Jul 4, 2024