FlowKit icon indicating copy to clipboard operation
FlowKit copied to clipboard

Performance Issues with DistanceCounterparts

Open gzagatti opened this issue 6 years ago • 1 comments

Describe the bug The DistanceCounterparts query class did not complete execution after a period of about two weeks. This query class completed successfully for a small subset of subscribers (~ 25k), however for a bigger subset (~ 6.5 millions) the query never finished and I was cancelled it.

We should investigate the performance of this type of query and attempt to optimize the underlying SQL code.

Product Flowmachine

Version master

To Reproduce

  1. Execute a DistanceCounterpart query with a large subscriber subset ( > 6 million)

Expected behavior The query should finish executing in reasonable time (less than 2 days).

gzagatti avatar May 09 '19 15:05 gzagatti

Let's start with adding a benchmark for this?

greenape avatar May 09 '19 16:05 greenape