docker
docker copied to clipboard
pelias
something in the download process has to be fixed
something in the download process has to be fixed :
raphy@WorldMap:~/pelias/docker/projects/portland-metro$ pelias elastic wait
waiting for elasticsearch service to come up
Elasticsearch up!
raphy@WorldMap:~/pelias/docker/projects/portland-metro$ pelias elastic create
Creating pelias_schema_run ... done
--------------
create index
--------------
[put mapping] pelias { acknowledged: true, shards_acknowledged: true, index: 'pelias' }
raphy@WorldMap:~/pelias/docker/projects/portland-metro$ pelias download all
Creating pelias_openaddresses_run ...
Creating pelias_csv-importer_run ...
Creating pelias_whosonfirst_run ...
Creating pelias_openstreetmap_run ...
Creating pelias_transit_run ...
Creating pelias_transit_run ... done
info: [csv-download] Attempting to download selected data files: https://raw.githubusercontent.com/pelias/csv-importer/master/data/example.csv
info: [csv-download] Downloading https://raw.githubusercontent.com/pelias/csv-importer/master/data/example.csv to /data/csv/example.csv
info: [openstreetmap-download] Downloading sources: https://data.geocode.earth/archive/portland-metro/2022-06-20/portland_oregon.osm.pbf
warn: [openaddresses] source definitions no longer require a file extension 'us/or/portland_metro.csv'
warn: [openaddresses] source definitions no longer require a file extension 'us/or/city_of_salem.csv'
warn: [openaddresses] source definitions no longer require a file extension 'us/or/marion_and_polk.csv'
warn: [openaddresses] source definitions no longer require a file extension 'us/or/marion.csv'
warn: [openaddresses] source definitions no longer require a file extension 'us/or/hood_river.csv'
warn: [openaddresses] source definitions no longer require a file extension 'us/wa/city_of_richland.csv'
warn: [openaddresses] source definitions no longer require a file extension 'us/wa/clark.csv'
info: [csv-download] all done
info: [openaddresses-download] Attempting to download selected data sources: us/or/portland_metro,us/or/city_of_salem,us/or/marion_and_polk,us/or/marion,us/or/hood_river,us/wa/city_of_richland,us/wa/clark
info: [openaddresses-download] Downloading us/or/portland_metro
wget https://gbfs.biketownpdx.com/gbfs/en/station_information.json to /data/transit/BIKETOWN-hubs.json
info: [openstreetmap-download] All done!
info: [whosonfirst] Downloading whosonfirst-data-admin-us-latest.db.bz2
info: [whosonfirst] Downloading whosonfirst-data-postalcode-us-latest.db.bz2
wget http://developer.trimet.org/schedule/gtfs.zip to /data/transit/TRIMET-stops.txt
info: [interpolation(TIGER)] downloaded tl_2021_41067_addrfeat.zip
info: [interpolation(TIGER)] downloaded tl_2021_41051_addrfeat.zip
info: [interpolation(TIGER)] downloaded tl_2021_41005_addrfeat.zip
info: [interpolation(TIGER)] downloaded tl_2021_41071_addrfeat.zip
info: [interpolation(TIGER)] downloaded tl_2021_41047_addrfeat.zip
info: [openaddresses-download] Downloading us/or/city_of_salem
info: [interpolation(TIGER)] downloaded tl_2021_41053_addrfeat.zip
info: [interpolation(TIGER)] downloaded tl_2021_53011_addrfeat.zip
info: [interpolation(TIGER)] downloads complete
info: [openaddresses-download] Downloading us/or/marion_and_polk
info: [openaddresses-download] Downloading us/or/marion
info: [openaddresses-download] Downloading us/or/hood_river
info: [whosonfirst] done downloading whosonfirst-data-postalcode-us-latest.db.bz2
info: [openaddresses-download] Downloading us/wa/city_of_richland
info: [openaddresses-download] Downloading us/wa/clark
info: [openaddresses-download] All done!
info: [whosonfirst] done downloading whosonfirst-data-admin-us-latest.db.bz2
info: [whosonfirst] All done!
info: [transit] unzipping stops.txt from /data/transit/TRIMET.zip (out: /data/transit/TRIMET-stops.txt)
unzip stops.txt to /data/transit/TRIMET-stops.txt
wget https://data.geocode.earth/archive/portland-metro/2022-06-20/C-TRAN.zip to /data/transit/C-TRAN-stops.txt
info: [transit] unzipping stops.txt from /data/transit/C-TRAN.zip (out: /data/transit/C-TRAN-stops.txt)
unzip stops.txt to /data/transit/C-TRAN-stops.txt
wget http://oregon-gtfs.com/gtfs_data/rideconnection-or-us/rideconnection-or-us.zip to /data/transit/RIDECONNECTION-stops.txt
Error: Server responded to http://oregon-gtfs.com/gtfs_data/rideconnection-or-us/rideconnection-or-us.zip with status code 404:
<html>
<head><title>404 Not Found</title></head>
<body>
<center><h1>404 Not Found</h1></center>
<hr><center>nginx</center>
</body>
</html>
at Response.getBody (/code/pelias/transit/node_modules/http-response-object/lib/index.js:41:23)
at downloadFile (/code/pelias/transit/lib/prep_data.js:73:40)
at /code/pelias/transit/lib/prep_data.js:34:17
at Array.forEach (<anonymous>)
at Object.<anonymous> (/code/pelias/transit/lib/prep_data.js:24:21)
at Module._compile (node:internal/modules/cjs/loader:1364:14)
at Module._extensions..js (node:internal/modules/cjs/loader:1422:10)
at Module.load (node:internal/modules/cjs/loader:1203:32)
at Module._load (node:internal/modules/cjs/loader:1019:12)
at Function.executeUserEntryPoint [as runMain] (node:internal/modules/run_main:128:12) {
statusCode: 404,
headers: {
date: 'Thu, 12 Jun 2025 10:27:30 GMT',
'content-type': 'text/html',
'transfer-encoding': 'chunked',
connection: 'close',
'cf-cache-status': 'BYPASS',
'set-cookie': [
'__cf_bm=JoUykHsI8Lmnhhp.bbXKBn0fx6tabMr8MJI0yGid5vA-1749724050-1.0.1.1-nekYrqCDiqTexsuHqyKcoXLh4BdtVCFKrv2DUDovIKsufG8Tl7zp8V6ITgp.Y6awXp1Vq1Vs55U27qbGACgBPCZ2FLnc1IOdT3kIGiF7qvE; path=/; expires=Thu, 12-Jun-25 10:57:30 GMT; domain=.oregon-gtfs.com; HttpOnly'
],
vary: 'Accept-Encoding',
'report-to': '{"endpoints":[{"url":"https:\\/\\/a.nel.cloudflare.com\\/report\\/v4?s=glWUmYpxxoUGkXpYPfaRiH2s4sI%2F6OxCP6NiBKiAzdZFk5wzB2yA0c94Jzh%2Fv8mN0MDPEjRXy6N0THDqoA%2BpqcLEllRV1bNfA%2Br%2B%2FP8PQtk2ma526p9wkAuFsSUlcsBfeFU%3D"}],"group":"cf-nel","max_age":604800}',
nel: '{"success_fraction":0,"report_to":"cf-nel","max_age":604800}',
server: 'cloudflare',
'cf-ray': '94e8a7ef8c3be7ae-FRA',
'alt-svc': 'h3=":443"; ma=86400',
'server-timing': 'cfL4;desc="?proto=TCP&rtt=4694&min_rtt=4694&rtt_var=2347&sent=1&recv=3&lost=0&retrans=0&sent_bytes=0&recv_bytes=146&delivery_rate=0&cwnd=249&unsent_bytes=0&cid=0000000000000000&ts=0&x=0"'
},
body: <Buffer 3c 68 74 6d 6c 3e 0d 0a 3c 68 65 61 64 3e 3c 74 69 74 6c 65 3e 34 30 34 20 4e 6f 74 20 46 6f 75 6e 64 3c 2f 74 69 74 6c 65 3e 3c 2f 68 65 61 64 3e 0d ... 96 more bytes>,
url: 'http://oregon-gtfs.com/gtfs_data/rideconnection-or-us/rideconnection-or-us.zip'
}
Had an issue obtaining new file /data/transit/RIDECONNECTION-stops.txt
wget http://oregon-gtfs.com/gtfs_data/sandy-or-us/sandy-or-us.zip to /data/transit/SAM-stops.txt
Error: Server responded to http://oregon-gtfs.com/gtfs_data/sandy-or-us/sandy-or-us.zip with status code 404:
<html>
<head><title>404 Not Found</title></head>
<body>
<center><h1>404 Not Found</h1></center>
<hr><center>nginx</center>
</body>
</html>
at Response.getBody (/code/pelias/transit/node_modules/http-response-object/lib/index.js:41:23)
at downloadFile (/code/pelias/transit/lib/prep_data.js:73:40)
at /code/pelias/transit/lib/prep_data.js:34:17
at Array.forEach (<anonymous>)
at Object.<anonymous> (/code/pelias/transit/lib/prep_data.js:24:21)
at Module._compile (node:internal/modules/cjs/loader:1364:14)
at Module._extensions..js (node:internal/modules/cjs/loader:1422:10)
at Module.load (node:internal/modules/cjs/loader:1203:32)
at Module._load (node:internal/modules/cjs/loader:1019:12)
at Function.executeUserEntryPoint [as runMain] (node:internal/modules/run_main:128:12) {
statusCode: 404,
headers: {
date: 'Thu, 12 Jun 2025 10:27:30 GMT',
'content-type': 'text/html',
'transfer-encoding': 'chunked',
connection: 'close',
'cf-cache-status': 'BYPASS',
'set-cookie': [
'__cf_bm=m24GcXpPHndlKUAxP78P2rwpNVVZQpg7wUwoqNtT_ck-1749724050-1.0.1.1-OfWBf0Z6t0BtX_JHjeZ9xf7XwppMlK0JvfSZ5Av3efup3VrgQdDzKVP82wv6eJAQy14QG144QAKuPAjbDcOtfSagS4z2uChX484J.aWjzAI; path=/; expires=Thu, 12-Jun-25 10:57:30 GMT; domain=.oregon-gtfs.com; HttpOnly'
],
vary: 'Accept-Encoding',
'report-to': '{"endpoints":[{"url":"https:\\/\\/a.nel.cloudflare.com\\/report\\/v4?s=GZFLyGqcf7uinozciM%2Bd%2BGYhxIBshfXmK6AUgJ09Qt24AU8nQFibGwD2FnlVDOS2XwcX6LI4uj07351BDUqfus9pqoGKtdvuj0r2wxrDUHmBik%2BnR0ivxW0PssneCa9p9q4%3D"}],"group":"cf-nel","max_age":604800}',
nel: '{"success_fraction":0,"report_to":"cf-nel","max_age":604800}',
server: 'cloudflare',
'cf-ray': '94e8a7f32f399131-FRA',
'alt-svc': 'h3=":443"; ma=86400',
'server-timing': 'cfL4;desc="?proto=TCP&rtt=4660&min_rtt=4660&rtt_var=2330&sent=1&recv=3&lost=0&retrans=0&sent_bytes=0&recv_bytes=128&delivery_rate=0&cwnd=249&unsent_bytes=0&cid=0000000000000000&ts=0&x=0"'
},
body: <Buffer 3c 68 74 6d 6c 3e 0d 0a 3c 68 65 61 64 3e 3c 74 69 74 6c 65 3e 34 30 34 20 4e 6f 74 20 46 6f 75 6e 64 3c 2f 74 69 74 6c 65 3e 3c 2f 68 65 61 64 3e 0d ... 96 more bytes>,
url: 'http://oregon-gtfs.com/gtfs_data/sandy-or-us/sandy-or-us.zip'
}
Had an issue obtaining new file /data/transit/SAM-stops.txt
wget http://data.trilliumtransit.com/gtfs/wilsonville-or-us/wilsonville-or-us.zip to /data/transit/SMART-stops.txt
info: [transit] unzipping stops.txt from /data/transit/SMART.zip (out: /data/transit/SMART-stops.txt)
unzip stops.txt to /data/transit/SMART-stops.txt
wget http://oregon-gtfs.com/gtfs_data/swanisland-or-us/swanisland-or-us.zip to /data/transit/SWAN-stops.txt
Error: Server responded to http://oregon-gtfs.com/gtfs_data/swanisland-or-us/swanisland-or-us.zip with status code 404:
<html>
<head><title>404 Not Found</title></head>
<body>
<center><h1>404 Not Found</h1></center>
<hr><center>nginx</center>
</body>
</html>
at Response.getBody (/code/pelias/transit/node_modules/http-response-object/lib/index.js:41:23)
at downloadFile (/code/pelias/transit/lib/prep_data.js:73:40)
at /code/pelias/transit/lib/prep_data.js:34:17
at Array.forEach (<anonymous>)
at Object.<anonymous> (/code/pelias/transit/lib/prep_data.js:24:21)
at Module._compile (node:internal/modules/cjs/loader:1364:14)
at Module._extensions..js (node:internal/modules/cjs/loader:1422:10)
at Module.load (node:internal/modules/cjs/loader:1203:32)
at Module._load (node:internal/modules/cjs/loader:1019:12)
at Function.executeUserEntryPoint [as runMain] (node:internal/modules/run_main:128:12) {
statusCode: 404,
headers: {
date: 'Thu, 12 Jun 2025 10:27:32 GMT',
'content-type': 'text/html',
'transfer-encoding': 'chunked',
connection: 'close',
'cf-cache-status': 'BYPASS',
'set-cookie': [
'__cf_bm=vpgH.6KqCl9JkkGf9fKnKpOPF072_29EeBapPG8LH.c-1749724052-1.0.1.1-deILKqz9HRTUWOAVg8bfEmrx442gCTL7F4rUG7Dbk0yPtilSMZvgttCJOpNCVymJ..VRv74fq_oR8fI5FD.L.xvUDKLbZrjofEA9uOFx3MA; path=/; expires=Thu, 12-Jun-25 10:57:32 GMT; domain=.oregon-gtfs.com; HttpOnly'
],
vary: 'Accept-Encoding',
'report-to': '{"endpoints":[{"url":"https:\\/\\/a.nel.cloudflare.com\\/report\\/v4?s=kdDiBJQUZWgdNuDcAQWniJUQyrI7ST3I5Afm7STiSO2X9M%2Blhys8vfiNwkzUcNyCM4lHaZd%2B2EzBdgAOAAMPkcsHqYpO%2FReHtuvLKw24V1ardRLlL00ldCgNLDyJMDFaQYA%3D"}],"group":"cf-nel","max_age":604800}',
nel: '{"success_fraction":0,"report_to":"cf-nel","max_age":604800}',
server: 'cloudflare',
'cf-ray': '94e8a7fc0dbcd411-FRA',
'alt-svc': 'h3=":443"; ma=86400',
'server-timing': 'cfL4;desc="?proto=TCP&rtt=5504&min_rtt=5504&rtt_var=2752&sent=1&recv=3&lost=0&retrans=0&sent_bytes=0&recv_bytes=138&delivery_rate=0&cwnd=249&unsent_bytes=0&cid=0000000000000000&ts=0&x=0"'
},
body: <Buffer 3c 68 74 6d 6c 3e 0d 0a 3c 68 65 61 64 3e 3c 74 69 74 6c 65 3e 34 30 34 20 4e 6f 74 20 46 6f 75 6e 64 3c 2f 74 69 74 6c 65 3e 3c 2f 68 65 61 64 3e 0d ... 96 more bytes>,
url: 'http://oregon-gtfs.com/gtfs_data/swanisland-or-us/swanisland-or-us.zip'
}
Had an issue obtaining new file /data/transit/SWAN-stops.txt
info: [transit] done unzipping SMART-stops.txt
info: [transit] done unzipping C-TRAN-stops.txt
info: [transit] done unzipping TRIMET-stops.txt
Error: Server responded to http://oregon-gtfs.com/gtfs_data/swanisland-or-us/swanisland-or-us.zip with status code 404:
404 Not Found
There's a 'reporting errors and issues' link at the bottom of https://oregon-gtfs.com/
As it is usually the case for these Errors. The URLs have changed.
https://oregon-gtfs.trilliumtransit.com/gtfs_data/swanisland-or-us/swanisland-or-us.zip
and for the other providers in the pelias.json for the portland-metro example, you can find them here.
https://oregon-gtfs.com/#gtfs-static-feeds
Contribute to this project by just fixing it in the pelias.json here https://github.com/pelias/docker/blob/master/projects/portland-metro/pelias.json via PULL-Request and for your own service directly via your pelias.json Config-File.
@CeallachKN
I don't think I have time to waste to help pelias fixing its issues
Look at this wonderful comment:
https://github.com/pelias/docker/issues/381#issuecomment-2966588198
I don't think I have time to waste to help pelias fixing its issues
Look at this wonderful comment:
So you just want someone else to work for you for free?
