UMOE-Scaling-Unified-Multimodal-LLMs icon indicating copy to clipboard operation
UMOE-Scaling-Unified-Multimodal-LLMs copied to clipboard

Published 20 hours ago • verified publisher icon HITsz-TMG

Audio Understanding for Uni-MoE v2

Open IanZ2020 opened this issue 8 months ago • 2 comments

I found that Uni-MoE v2 is not trained on audio understanding tasks and not utilizing the BEATs audio encoder.

Is Uni-MoE v2 not designed for understanding general audio events, like natural sounds?

IanZ2020 avatar Jun 14 '24 09:06 IanZ2020