Move the operations on cache list to boundedElastic thread

Open Arooba-git opened this issue 2 years ago • 1 comments

Hi! :)

BlockHound detected some blocking calls in the Caching module:

The fix in PR prevents the operations from blocking the reactive pipeline Screen Shot 2023-07-11 at 2 40 40 PM

We re-ran the tests to ensure the fix was non-intrusive and also measured the performance (in terms of CPU usage) before and after the fix: Before cohere-cpu-before

After cohere-cpu-after

Jul 11 '23 08:07 Arooba-git

bump

Jul 31 '23 12:07 Arooba-git