eodag icon indicating copy to clipboard operation
eodag copied to clipboard

[CREODIAS/AWS EOS/ASTRA_EOD] Downloads already existing product

Open remi-braun opened this issue 4 years ago • 1 comments

When searching with creodias or aws_eos, Eodag does not seem to be able to determine that the product has already been downloaded by another provider.

2022-01-07_17h38_47

It is due (I think) to the fact that these providers download files with a different name than the other providers:

  • usual providers; S2A_MSIL1C_20191215T110441_N0208_R094_T30TXP_20191215T114155.SAFE (or .zip)
  • earth_search : S2A_MSIL1C_20191215T110441_N0208_R094_T30TXP_20191215T114155 (but OK)
  • creodias: S2A_MSIL1C_20191215T110441_N0208_R094_T30TXP_20191215T114155.SAFE.zip
  • aws_eos: S2A_MSIL2A_20191215T110441____________T30TXP________________
  • astra_eod: S2A_OPER_MSI_L2A_TL_MTI__20191215T122756_A023400_T30TXP_N02.13

Environment:

Python version: Python 3.7.12
EODAG version: eodag (Earth Observation Data Access Gateway): version 2.3.4

remi-braun avatar Jan 07 '22 16:01 remi-braun

This is related to #251 and the discussion on products download directories.

  • [ ] astraea_eod does not provide directly the SAFE formatted product ID. We should do like with aws_eos and build an incomplete ID (filled with _) but structured like a SAFE ID.
  • [ ] when checking if a product has already been downloaded, we should compare folder names without including _ characters

sbrunato avatar Jan 10 '22 08:01 sbrunato