cody icon indicating copy to clipboard operation
cody copied to clipboard

Add feature flag to reduce debounce time

Open philipp-spiess opened this issue 1 year ago • 0 comments

Closes CODY-1533

Gives us back one of the few (only?) client-side lever we still have for latency. When this feature flag is on, we only have a 25ms debounce time (as we did in our initial versions). Note that this will also increase backend pressure and load when enabled, which might have a negative impact on latency too.

Test plan

  • Enable the cody-autocomplete-reduced-debounce feature flag (I did it by patching the source code but you can also connect to sg locally and enable it in the instance)
  • Trigger a completion and notice slightly faster completions. I enabled tracing for me and checked out a trace.
Screenshot 2024-05-16 at 12 56 09

philipp-spiess avatar May 16 '24 10:05 philipp-spiess