Ian Dees
Ian Dees
Nothing in the footprints database, so closing this: ``` footprints=> select id,filename,resolution,source,url,min_zoom,max_zoom,priority,approximate_zoom from footprints where source='boem_gom_bathy'; id | filename | resolution | source | url | min_zoom | max_zoom |...
(I'm basically repeating what @mojodna said above but more explicitly. These were all run from an instance in AWS.) #### Listing files ``` lftp \ -c 'find' \ ftp://ftp.geogratis.gc.ca/pub/nrcan_rncan/elevation/cdem_mnec/ \...
(Transcoding is complete and footprints are inserted)
It seems like we downloaded an older version of this data. There's a newer, higher-resolution dataset at http://open.canada.ca/data/en/dataset/957782bf-847c-4644-a757-e383c0057995? Download link for this dataset is http://ftp.maps.canada.ca/pub/elevation/dem_mne/highresolution_hauteresolution/dsm_mns/2m/
Data download URL is http://gis.ktn.gv.at/OGD/Geographie_Planung/ogd-10m-at.zip
#### Mirror the source ``` curl https://gis.ktn.gv.at/OGD/Geographie_Planung/ogd-10m-at.zip | AWS_PROFILE=openterrain aws s3 cp - s3://elevation-sources-prod/austria/ogd-10m-at.zip ```
#### Transcode the source ``` make submit-job job=aws/transcode-job.json.hbs input=s3://elevation-sources-prod/austria/ogd-10m-at.zip output=s3://elevation-sources-transcoded/austria/ogd-10m-at name=ogd_10m_at ```
The transcode failed (likely due to running out of swap space on the ECS instance), so I ran it locally on my laptop.
Getting the download URLs looks like this: ``` curl -s http://www.geostore.com/environment-agency/rest/product/EA_SUPPLIED_OS_10KM/SP16?catalogName=Survey \ | jq -r '.[] | select(.coverageLayer | contains("LIDAR-DSM-1M-ENGLAND-EA-MD-YY")) | "http://www.geostore.com/environment-agency/rest/product/download/\(.guid)\t\(.fileName)"' ``` This returns a TSV with the URL...
I put together a script to scrape together all the URLs: https://github.com/iandees/uk-lidar The `catalog.csv` file has tens of thousands of lines in it, but we only need some of them....