LightRAG icon indicating copy to clipboard operation
LightRAG copied to clipboard

[Feature Request]: Models warm up hook

Open Garito opened this issue 2 months ago • 0 comments

Do you need to file a feature request?

  • [x] I have searched the existing feature request and this feature request is not already filed.
  • [x] I believe this is a legitimate feature request, not just a question or bug.

Feature Request Description

In order to reduce the llms costs, a lot of cloud providers allow to start and stop the machines that run those models Would be nice to have a hook that when a document is being analyzed, we could make the analysis to stop to wait for the models to be redeployed and then processed That would be nice to have a hook for every model in use

Additional Context

No response

Garito avatar Oct 22 '25 00:10 Garito