way to "preload" the checkpoint for inference?

[jryebread]

I notice everytime I run the model with run_mp.sh it reloads the checkpoint each time, for speed up is there any easy way to have the model preloaded ? anyone have code change suggestions to achieve this?

[Doubiiu]

Hi. It seems that this is a feature combining gradio_app.py and bash shell script run_mp.sh. I think it is a little bit troublesome to implement this.

[baller]

Why is there no result after running