DeepResearch icon indicating copy to clipboard operation
DeepResearch copied to clipboard

Manage the vLLM lifecycle

Open tobrun opened this issue 3 months ago • 2 comments

This is a first step towards improving the usability and robustness of this repository. This change ensures we clean up all the vLLM instances when we exit:

  • finished executing the task
  • error occurs
  • keyboard interruption

imo, this isn't the optimal solution. I personally would love to divide the LLM engine lifetime from the actual job processing but that is for a future PR.

closes #109

tobrun avatar Sep 18 '25 17:09 tobrun