ast-finetuned-audioset-10-1.../README.md

19 lines
1.1 KiB
Markdown
Raw Normal View History

2022-11-21 18:40:49 +08:00
---
license: bsd-3-clause
2022-11-21 18:42:14 +08:00
tags:
- audio-classification
2022-11-21 18:40:49 +08:00
---
# Audio Spectrogram Transformer (fine-tuned on AudioSet)
Audio Spectrogram Transformer (AST) model fine-tuned on AudioSet. It was introduced in the paper [AST: Audio Spectrogram Transformer](https://arxiv.org/abs/2104.01778) by Gong et al. and first released in [this repository](https://github.com/YuanGongND/ast).
Disclaimer: The team releasing Audio Spectrogram Transformer did not write a model card for this model so this model card has been written by the Hugging Face team.
## Model description
2022-11-21 18:42:44 +08:00
The Audio Spectrogram Transformer is equivalent to [ViT](https://huggingface.co/docs/transformers/model_doc/vit), but applied on audio. Audio is first turned into an image (as a spectrogram), after which a Vision Transformer is applied. The model gets state-of-the-art results on several audio classification benchmarks.
2022-11-21 18:40:49 +08:00
## Usage
2023-02-07 17:20:24 +08:00
You can use the raw model for classifying audio into one of the AudioSet classes. See the [documentation](https://huggingface.co/docs/transformers/main/en/model_doc/audio-spectrogram-transformer#transformers.ASTForAudioClassification.forward.example) for more info.