MiniCPM-V icon indicating copy to clipboard operation
MiniCPM-V copied to clipboard

[question] is there a best practice to sample audio input?

Open Yuuraa opened this issue 10 months ago • 1 comments

Love your amazing work! I'm trying to inference on audio input with your model, and facing OOM when dealing with long audio input.

I wanted to know if there is a best/frequently used practice to sample audio inputs, as uniform frame sampling for videos. Especially, I wonder do you think MiniCPM-o-2.6 will work for sampled audios as well.

I tried to find your code if there is audio sampling, but I couldn't. Thank you for so your consideration. :)

Yuuraa avatar Feb 23 '25 20:02 Yuuraa

Generally speaking, we don't recommend sampling audio input, as this can severely compromise the semantic integrity of the audio.

Please send me the length of the audio you need to process, and I'll provide specific suggestions.

tc-mb avatar Aug 14 '25 07:08 tc-mb