analyst-server icon indicating copy to clipboard operation
analyst-server copied to clipboard

Shapefile import is slow

Open mattwigway opened this issue 10 years ago • 2 comments
trafficstars

I always thought that this was due to the shapefiles themselves, but even when importing GeoBufs, which should be blazing fast, the shape feature stores are dog-slow.

mattwigway avatar Aug 26 '15 20:08 mattwigway

It's to the point now where importing a 119k feature shapefile times out the proxy server.

mattwigway avatar Sep 18 '15 14:09 mattwigway

Two things appear to be causing much of the slowness:

  1. Converting attribute names to attribute IDs - we can just cache the attribute IDs.
  2. reverse-sorting the features by ID. Since the IDs are arbitrary, we can just assign them in such a way that the are presorted, then we won't have to sort them.

mattwigway avatar Sep 18 '15 15:09 mattwigway