hootenanny icon indicating copy to clipboard operation
hootenanny copied to clipboard

Tune uses of HilbertRTree to speed up accesses to geospatial indexing

Open bwitham opened this issue 5 years ago • 4 comments

I believe alll the HilbertRTree indexing values have been based on a single trial run against a single dataset. Doing some more intensive testing and against a handful of datasets may end up helping overall runtime performance. Look for refs to this issue in code. For very large datasets, I've noticed for various conflation types where pulling surrounding features from the geospatial index is a performance bottleneck.

bwitham avatar Mar 13 '19 13:03 bwitham

Going to take a shot at this only for the sake of possibly speeding up the conflate run for roads from #3530. If nothing comes out of some short time spent on this, then will shelve it to backlog for the time being since doing this for all tree instances will take a significant amount of time.

bwitham avatar Oct 11 '19 03:10 bwitham

The bottleneck in #3530 doesn't have to do with this indexing, so shelving.

bwitham avatar Oct 11 '19 19:10 bwitham

Actually it might...

bwitham avatar Oct 14 '19 17:10 bwitham

Going to take a look at this, since it is a bottleneck in some conflate scenarios. Not sure if tuning will help or not yet.

bwitham avatar Feb 21 '20 17:02 bwitham