CMG icon indicating copy to clipboard operation
CMG copied to clipboard

self.audio_semantic_decoder and self.Audio_decoder

Open 1090h2400 opened this issue 1 year ago • 1 comments

https://github.com/haihuangcode/CMG/blob/2cbdad8f68d6000657ddf45ace97c855c022334d/code/src/model/main_model_2.py#L507C1-L515C60

Hi sir! Thanks for your great work! I have some questions I would like to ask you. I don't know if it's right to understand it this way: self.audio_semantic_decoder and self. Audio_decoder are used for classification and feature reconstruction, respectively. I also have a question about whether this work is using a transformer model? because I noticed a UniEncoder.py file

Looking forward to hearing from you!

1090h2400 avatar Nov 16 '23 02:11 1090h2400