AudioLDM icon indicating copy to clipboard operation
AudioLDM copied to clipboard

Published 20 hours ago • verified publisher icon haoheliu

CLAP checkpoint

Open ThibaultCastells opened this issue 1 year ago • 3 comments

Hello, I would like to finetune AudioLDM but I couldn't find any checkpoint for the CLAP model you used. Did I miss it? If not, could you share it? Thank you!

ThibaultCastells avatar Jun 05 '23 09:06 ThibaultCastells

@haoheliu could you let me know if releasing this checkpoint would be possible? Thank you!

ThibaultCastells avatar Jun 08 '23 04:06 ThibaultCastells

@ThibaultCastells Sorry for the delay. You can use the checkpoint (music_speech_epoch_15_esc_89.25.pt) in this repo https://github.com/LAION-AI/CLAP, which can work the same as the CLAP checkpoint we used.

haoheliu avatar Jul 10 '23 16:07 haoheliu

Thank you for the answer! Just to check: do you have a checkpoint that is compatible with the HuggingFace AudioLDM pipeline, which uses the transformers.ClapAudioModelWithProjection class? I tried to load it but had some issues (see the related discussion here)

ThibaultCastells avatar Jul 29 '23 03:07 ThibaultCastells