fish-speech icon indicating copy to clipboard operation
fish-speech copied to clipboard

Swallowing words, reading normally at first, then speeding up, and then not reading the last word of the sentence completely

Open Liwenru88 opened this issue 1 year ago • 2 comments

Self Checks

  • [X] This template is only for bug reports. For questions, please visit Discussions.
  • [X] I have thoroughly reviewed the project documentation (installation, training, inference) but couldn't find information to solve my problem. English 中文 日本語 Portuguese (Brazil)
  • [X] I have searched for existing issues, including closed ones. Search issues
  • [X] I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [X] [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
  • [x] Please do not modify this template and fill in all required fields.

Cloud or Self Hosted

Self Hosted (Source)

Environment Details

ubuntu 20.04,python3.10 ,torch2.4.1+cu121

Reference Audio: http://101.201.69.129:22122/audio/tts-reference-audio/f8693be5-13de-423d-bae2-ba8d6ddb5ff3.wav

Steps to Reproduce

Example text:摇身化为冲击一线的卫士,他们也有家庭,也有妻子爱人和父母,但他们不曾畏惧,不曾退缩,全国各地的医护人员,自发组成应援团队,身负神圣的使命,前往湖北一线,此时的他们也是逆行者,在人们纷纷远离这座城市时,他们决定迎难而上,因为在离开医校进入工作时,他们做了庄严的宣誓,但这不是义务,更多的是一份责任,一份担当,一份大爱无疆

✔️ Expected Behavior

Complete reading verbatim

❌ Actual Behavior

Speed ​​up in the middle, and fail to read the last word completely http://123.57.76.115:22122/test-video/error.wav

Liwenru88 avatar Oct 23 '24 15:10 Liwenru88

We have made some DPO tricks to the model, this problem is now relieved.

PoTaTo-Mika avatar Nov 07 '24 10:11 PoTaTo-Mika

We have made some DPO tricks to the model, this problem is now relieved.

Hi, i now meet the same problem, could you give more infomation about your DPO tricks? thanks

Lock1994 avatar Dec 03 '24 08:12 Lock1994

This issue is stale because it has been open for 30 days with no activity.

github-actions[bot] avatar Jan 03 '25 00:01 github-actions[bot]

This issue was closed because it has been inactive for 14 days since being marked as stale.

github-actions[bot] avatar Jan 18 '25 00:01 github-actions[bot]