wsd12345

Results 2 issues of wsd12345

### Self Checks - [X] This is only for bug report, if you would like to ask a question, please head to [Discussions](https://github.com/fishaudio/fish-speech/discussions). - [X] I have searched for existing...

bug

**Description** I use ensemble and python_backend. After 10 warmup with random data, The same data in the first inference time especially long, the second time to reach the expected time....