getSpatialData icon indicating copy to clipboard operation
getSpatialData copied to clipboard

getSentinel_data() generates HTTP 404 error

Open markbneal opened this issue 5 years ago • 9 comments

This code: getSentinel_data(records) results in this error: Column 'download_available' not present, calling check_availabilty() to check download availability of records... Error in .get(paste0(cred[3], "/odata/v1/Products('", x, "')/", field), : Not Found (HTTP 404). Failed to process request. It also appears to have happened to @egrabska on a webinar this morning, where she reports this as happening in the last few days, possibly due to a change at the ESA end?: https://youtu.be/k1K6nqgtRL8?t=1030 I'm happy to provide more details (code etc.) if this is not obvious where the problem lies.

I have loaded my code to github as a repo and script here. It can be run up to line 112 without error (though your own passwords are required, which i have stored as variables for myself).

markbneal avatar Nov 20 '20 08:11 markbneal

I am experiencing a similar problem. get_records(..., products = c("Sentinel-1", "Sentinel-2"), ...) returns the following error;

"Error in .get(url = cop.url(ext.xy = aoi, url.root = cred[3], product_name = product_name, : Internal Server Error (HTTP 500). Failed to process request."

ckukunda avatar Nov 20 '20 09:11 ckukunda

@ckukunda , I think your issue is different, as you are trying to get records, whereas I am getting data. I have had no trouble getting records. Perhaps log a separate issue with more explicit code?

markbneal avatar Nov 20 '20 10:11 markbneal

I am having the same issue of 1) I can get records and 2) and I cannot download using get data, same error I attempted to download using wget instead of R and getSpatialData package and it works, so it doesn't look like it's Sentinel server issue

My error:

Column 'download_available' not present, calling check_availabilty() to check download availability of records... Error in .get(paste0(cred[3], "/odata/v1/Products('", x, "')/", field), : Not Found (HTTP 404). Failed to process request.

jburmistrova avatar Nov 20 '20 20:11 jburmistrova

Is the problem as simple as a change in the directory/path format in the paste0()? If so, it might not be that difficult to fix with a pull request, though I'm not sure myself how to work out what the new correct path is?

markbneal avatar Nov 22 '20 21:11 markbneal

I managed to solve this problem in parts. I added records$download_available<-T but the check after the download was very slow.

franciscoseger avatar Nov 23 '20 17:11 franciscoseger

I have the same issue, also with the example given on the main page of this repo. On windows I get a path error when I use: records$download_available<-T as solution. On Ubuntu the solution works.

Muesgen avatar Dec 07 '20 14:12 Muesgen

Additionally, due to the dependency on check_availability(), order_data() from LTA does not work.

Muesgen avatar Dec 08 '20 10:12 Muesgen

I am having similar problem:

getSentinel_data(records = records_filtered[1,],dir_out=outdir_raw)
Column 'download_available' not present, calling check_availabilty() to check download availability of records...
Error in .get(paste0(cred[3], "/odata/v1/Products('", x, "')/", field),  : 
  Not Found (HTTP 404). Failed to process request.

I have no problem downloading the records. It was working fine even a week back!

The interesting thing is when I try wget on the url with userid and password in terminal, it gives me `401 Unauthorized' error. Have you faced a similar issue?

subhomoyghosh avatar Dec 15 '20 18:12 subhomoyghosh

@markbneal I have tried the script you provided and I can not get passed

view_aoi()
get_aoi() 

That is after setting the aoi. Could you try and let me know. Thanks.

henrykironde avatar Jan 14 '21 06:01 henrykironde