holmesgpt icon indicating copy to clipboard operation
holmesgpt copied to clipboard

Speed up cli startup time

Open aantn opened this issue 6 months ago • 5 comments

What happened?

It currently takes some time for the HolmesGPT cli to start running. Ideally the cli should:

  1. Start much faster
  2. Reflect to the user in a live-manner what is taking time during startup so the user can make any adjustments if they like (e.g. disabling toolsets that take too long to load)

Goal

Reduce the time from starting to run HolmesGPT until the first LLM call is made

Proposal

  1. Implement https://github.com/robusta-dev/holmesgpt/issues/426
  2. Do performance profiling on HolmesGPT's startup and find other areas to improve

aantn avatar May 16 '25 14:05 aantn

Maybe we don't have to test the prerequisites every time the holmes runs, we can load it once and cache the status of the each toolsets?

mainred avatar May 21 '25 15:05 mainred

and if the requirement meets when the user updates the toolset status and we need to update the cache, we can provide a external flag like --refresh-toolset-cache to update the toolset status cache.

mainred avatar May 21 '25 15:05 mainred

@aantn please assign this issue to me.

mainred avatar May 21 '25 15:05 mainred

@mainred with pleasure! Thoughts on #426 as a fix? The solutions you suggest also sound good.

aantn avatar May 21 '25 15:05 aantn

Another related fix: we can make --interactive mode default which will mean startup happens less often.

aantn avatar May 21 '25 15:05 aantn