s1ard icon indicating copy to clipboard operation
s1ard copied to clipboard

How to check whether all ARD products exist?

Open johntruckenbrodt opened this issue 1 year ago • 0 comments

For ARD generation, the processor.py script executes the following main steps:

  • select all scenes based on the user-defined search criteria
  • group the scenes by acquisition time (data take)
  • for each group:
    • select all overlapping MGRS tiles
      • for each tile:
        • start function ard.format

Inside ard.format, the function ard.get_datasets is called, which collects all relevant processed files and performs a check whether the part of the file overlapping with the MGRS tile contains any valid data. If it doesn't, the processed product is ignored and its files not returned by the function (because they are not relevant for creating the current ARD product).
As important as this is, it leads to the situation that the full list of ARD files that should exist can only be known if all processed SAR products exist. it would be good to know whether all ARD products exist from the source scene selection alone. Otherwise some scenes whose processing output had already been deleted are re-processed because the processor thinks some tiles are missing.
I currently see two options:

  • create dummy product folders with some note saying that the product was not created because the source products did not overlap with it
  • maintain some database/text file in ard_dir listing those products that were never created

johntruckenbrodt avatar Apr 04 '24 07:04 johntruckenbrodt