AudioCaption icon indicating copy to clipboard operation
AudioCaption copied to clipboard

Paper

Open redrabbit94 opened this issue 2 years ago • 4 comments

Thanks for sharing, great work! Could you offer links to articles about this repo, and is it convenient to know if the repo contains the method you submitted in dcase 2022?

redrabbit94 avatar Dec 08 '22 03:12 redrabbit94

  1. The articles are provided. However, since I have reorganized the codes several times, the detailed step-to-step instruction is not included. For example, run_condition_adverse.py is for diversity-controllable captioning but the configuration files and the discriminator training scripts are missing. If you have problems with specific work, please contact me.
  2. About DCASE 2022 submission, the contrastive pre-trained model is provided here. You can use this configuration and set the encoder argument pretrained as the path of the pre-trained model to train the base model. Reinforcement learning and ensemble codes will be uploaded later. However, I do not put the pre-training codes into this repo because it is independent. I will create another repo on audio-text retrieval involving contrastive pre-training.

wsntxxn avatar Dec 14 '22 12:12 wsntxxn

Sorry for the procrastination, the codes and sample configuration files for reinforcement learning and ensemble have been uploaded.

wsntxxn avatar Feb 01 '23 06:02 wsntxxn

The audio-text contrastive learning code has also been uploaded to https://github.com/wsntxxn/DCASE2022T6_CLAP. You can refer to it.

wsntxxn avatar Feb 16 '23 03:02 wsntxxn

Thanks so much!Best wishes!

发自我的iPhone

在 2023年2月16日,11:14,Xuenan Xu @.***> 写道:



The audio-text contrastive learning code has also been uploaded to https://github.com/wsntxxn/DCASE2022T6_CLAP. You can refer to it.

— Reply to this email directly, view it on GitHubhttps://github.com/wsntxxn/AudioCaption/issues/4#issuecomment-1432430494, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AHAX5M64Z2I5X327OFLJ5B3WXWLP7ANCNFSM6AAAAAASXT66S4. You are receiving this because you authored the thread.Message ID: @.***>

redrabbit94 avatar Feb 16 '23 04:02 redrabbit94