holmesgpt
holmesgpt copied to clipboard
Speed up cli startup time
What happened?
It currently takes some time for the HolmesGPT cli to start running. Ideally the cli should:
- Start much faster
- Reflect to the user in a live-manner what is taking time during startup so the user can make any adjustments if they like (e.g. disabling toolsets that take too long to load)
Goal
Reduce the time from starting to run HolmesGPT until the first LLM call is made
Proposal
- Implement https://github.com/robusta-dev/holmesgpt/issues/426
- Do performance profiling on HolmesGPT's startup and find other areas to improve
Maybe we don't have to test the prerequisites every time the holmes runs, we can load it once and cache the status of the each toolsets?
and if the requirement meets when the user updates the toolset status and we need to update the cache, we can provide a external flag like --refresh-toolset-cache to update the toolset status cache.
@aantn please assign this issue to me.
@mainred with pleasure! Thoughts on #426 as a fix? The solutions you suggest also sound good.
Another related fix: we can make --interactive mode default which will mean startup happens less often.