fish-speech icon indicating copy to clipboard operation
fish-speech copied to clipboard

[Bug]After fine-tuning, the sentence will end only after the first sentence is correct and there are many wrong words afterwards.

Open bobo-wmdigit opened this issue 1 year ago • 4 comments

用fap 对数据做了调整,并充分分割冲了长短不一的数据

训练了2000步,通过脚本完成了权重合并后,再推理,用官方权重可以正常生成声音,但是使用我新生成的权重,会导致只有第一句话是正确的,但是后面的声音都是一些无用的。

请问有什么办法来解决吗?

bobo-wmdigit avatar Aug 14 '24 21:08 bobo-wmdigit

请根据自己的数据集大小调整微调步数。

PoTaTo-Mika avatar Aug 15 '24 00:08 PoTaTo-Mika

我尝试了100,2000和10000步,情况都是类似,用微调后的模型,就第一句话能听清楚,后面要不过早要不长时间预测不到结束符,导致都是一些混乱的杂音。

bobo-wmdigit avatar Aug 16 '24 00:08 bobo-wmdigit

#515 Change title to English.

Stardust-minus avatar Sep 08 '24 08:09 Stardust-minus

@bobo-wmdigit did you also experience large pauses after the first few words? Did you manage to find a solution?

kznmft avatar Oct 30 '24 18:10 kznmft