Mostafa Ramadan comments

Repositories
Issues
Comments

Results 3 comments of


                                            Mostafa Ramadan

fish-speech.tools.api_server --compile Error: accessing tensor output of CUDAGraphs that has been overwritten by a subsequent run.

Hello @corporate9601 @libo5410391, Has anyone managed to solve the issue? Your help will be much appreciated, thanks.

fish-speech.tools.api_server --compile Error: accessing tensor output of CUDAGraphs that has been overwritten by a subsequent run.

I have made a temporary solution commented out the warmup execution and then sent two requests. Afterwards the server worked great.

fish-speech.tools.api_server --compile Error: accessing tensor output of CUDAGraphs that has been overwritten by a subsequent run.

> Hi [@mostafaramadann](https://github.com/mostafaramadann), can you share what you did? I got rid of the warmup by commenting out the `self.warm_up` call in `tools/server/model_manager.py`, but when I send a request I...