audio-captioning topic

Reading list for research topics in Sound AI

soham97

Source code for "MusCaps: Generating Captions for Music Audio" (IJCNN 2021)

ilaria-manco

Using pretrained encoder and language models to generate captions from multimedia inputs.

TheoCoombes

2nd place solution for 2020 DCASE challenge task 6 audio captioning. http://dcase.community/challenge2020/task-automatic-audio-captioning-results#wuyusong2020_t6

lukewys

Audio captioning baseline system for DCASE 2020 challenge.

audio-captioning

Song Describer is a data collection platform for annotating music with textual descriptions.

ilaria-manco

Audio Captioning datasets for PyTorch.

Labbeti

Tracking states of the arts and recent results (bibliography) on sound tasks.

soham97

Fluency ENhanced Sentence-bert Evaluation (FENSE), metric for audio caption evaluation. And Benchmark dataset AudioCaps-Eval, Clotho-Eval.

blmoistawinde

Python code for handling the Clotho dataset.

audio-captioning