AGStoShapefile icon indicating copy to clipboard operation
AGStoShapefile copied to clipboard

Published 20 hours ago • verified publisher icon tannerjt

Error after finished extracting chunks. How to merge multiple JSON files to single GeoJSON file?

Open yusufalma opened this issue 7 years ago • 4 comments
trafficstars

Dear Mr. Tanner,

Your code is very good to download data from ArcGIS REST server, but I found error after finished extracting chunks, as you can see in picture below:

agsout_error

How would you fix this problem? If I should merge multiple JSON files in folder "partials" by myself, how will I do that?

Regards, Yusuf Alma

yusufalma avatar Jan 24 '18 12:01 yusufalma

@yusufalma , I pushed out some updates that should take care of this. The problem was that when merging all the partial files into one, it was storing everything in memory AND THEN piping into a single file. This was causing backflow pressure and taking up memory. It should work fine now. I would also recommend adding a throttle (in milliseconds) to your services.txt file:

ie


http://maps.lacity.org/lahub/rest/services/Recreation_and_Parks_Department/MapServer/4|parks|1000

This will introduce a 1 second delay between requests

tannerjt avatar Jan 25 '18 23:01 tannerjt

Dear Mr. Tanner,

Thank you for quick response. The program can merge multiple JSON now. However, yesterday I found another error after merging finished below: agsout_error1 agsout_error2 agsout_error3 What was happened and can it be solved? Again, thank you for attention and cooperation.

Regards, Yusuf Alma

yusufalma avatar Jan 30 '18 00:01 yusufalma

Looks like you need to install gdal . See instruction on main readme.md file.

tannerjt avatar Jan 30 '18 01:01 tannerjt

Dear Mr. Tanner,

I have followed the instruction. Here is my Python, GDAL and node.js status: agsout_error4 What have I missed?

Regards, Yusuf Alma

yusufalma avatar Jan 30 '18 01:01 yusufalma