audiocraft icon indicating copy to clipboard operation
audiocraft copied to clipboard

MusicGen cross_attention=False?

Open sukun1045 opened this issue 1 year ago • 1 comments

I am confusing about the text2music config. It seems like in config/model/lm/default.yaml the cross_attention=False and I didn't see any overwrite in musicgen_lm.yaml but in the output of the fuser does include the original input and cross_attention_output. I am wondering whether the flag is set wrong or if I am missing something here. Thank you.

sukun1045 avatar Oct 02 '23 18:10 sukun1045

Confusing about the same question. self.cross_attention should have not executed when cross_attention=False but I don't know why the code ran successfully. Did you figure it out?

X-Drunker avatar Dec 08 '23 06:12 X-Drunker