Large model repetitive "Thank you" message

[pbochan]

Hello,

I'm facing a weird behaviour of how a large model reacts to an empty inference message: it keeps generating "Thank you" caption over and over again for English (for other languages, say, Ukrainian, it generates "Дякую", for Russian "Спасибо" and so on). The medium model (and other smaller models) generates "{BLANK_AUDIO}" or "[LAUGHING]" and so on.

How can large model react to empty inference results with at least "{BLANK_AUDIO}" but not with endless "Thank you" messages?

Thanks, P

[mechiland]

+1 on @pbochan

I've tried Chinese on ggml-large-v3.bin with language set to 'auto'. The original audio is Chinese, and the output is meanlinglessly repeating:

Feel like the model is polluted.

[pbochan]

@mechiland, thanks for a reply. Indeed, large model v1 does have way less “thank you” messages.