LightRAG
LightRAG copied to clipboard
[Feature Request]: Models warm up hook
Do you need to file a feature request?
- [x] I have searched the existing feature request and this feature request is not already filed.
- [x] I believe this is a legitimate feature request, not just a question or bug.
Feature Request Description
In order to reduce the llms costs, a lot of cloud providers allow to start and stop the machines that run those models Would be nice to have a hook that when a document is being analyzed, we could make the analysis to stop to wait for the models to be redeployed and then processed That would be nice to have a hook for every model in use
Additional Context
No response