eodag icon indicating copy to clipboard operation
eodag copied to clipboard

Script to get a health status check of searching products

Open maximlt opened this issue 4 years ago • 0 comments

Almost all the little scripts I run to test EODAG search for and download S2_MSI_L1C products only. This is what the API user guide does too. I sometimes wonder about the status of the other products made available by default (those configured in providers.yml per provider). I don't know how many of these product types are actually searched and downloaded out there.

I'd love to have a script that would go through each provider -> each product that it (EODAG) offers -> try to search for products (ideally, running dag.search to trigger a count request and then dag.search_iter_page with two iterations to test the next page mechanism) -> determine the status of a search made for each product_type/provider combination (was an error raised and if so which one? were there products returned? count value returned ? inspect an EOProduct returned to see if it has some important properties? ...) -> save the results.

It's not a big deal if this script takes ages to run, and it doesn't need to be run frequently. It would be a good health status check of searching products with EODAG, and probably uncover some bugs.

A few things that would need to be considered if it is created:

  • I don't know if all the product types have a global coverage. If not, the search area should be adapted when required
  • Same thing for the temporal search
  • There is actually no timeout in most of the requests we make. There should be a way to cancel a search after a given amount of time, and report that

(Downloading or starting to download a product would be the next step)

maximlt avatar Apr 28 '21 09:04 maximlt