eodag
eodag copied to clipboard
Retrieve feature and merge with vito_download project
Original report by Mickaël Savinaud (Bitbucket: savmickael, GitHub: savmickael).
https://github.com/DHI-GRAS/vito_download
vito_download
is a Python package dedicated to search and download products from the VITO pool websites http://land.copernicus.vgt.vito.be/PDF/datapool and https://www.vito-eodata.be/PDF/datapool/
This is its example usage:
import vito_download as vito
import xarray as xr
url = vito.build_url(product='SWI', year=2016, month=1, day=1)
local_files = vito.download_data(url, username='USERNAME', password='PASSWORD',
download_dir='.', include='*.nc')
dataset = xr.open_dataset(list(local_files)[0])
data = dataset['SWI_010'].values.squeeze()
The products supported are apparently listed in its config.py module:
product_url = {
'Water_Bodies_Global': 'https://land.copernicus.vgt.vito.be/PDF/datapool/Water/Water_Bodies/Water_Bodies_1km_Global_V2',
'SWI': 'http://land.copernicus.vgt.vito.be/PDF/datapool/Vegetation/Soil_Water_Index/Daily_SWI_12.5km_Global_V3',
'SWI10': 'http://land.copernicus.vgt.vito.be/PDF/datapool/Vegetation/Soil_Water_Index/10-daily_SWI_12.5km_Global_V3',
'SSM': 'http://land.copernicus.vgt.vito.be/PDF/datapool/Vegetation/Surface_Soil_Moisture/BioPar_SSM1km_V1_Global',
'Proba-V-S1-TOC': 'http://www.vito-eodata.be/PDF/datapool/Free_Data/PROBA-V_100m/S1_TOC_100_m_C1',
'Proba-V-S1-TOC-NDVI': 'http://www.vito-eodata.be/PDF/datapool/Free_Data/PROBA-V_100m/S1_TOC_NDVI_100_m__C1',
'Proba-V-S5-TOC': 'http://www.vito-eodata.be/PDF/datapool/Free_Data/PROBA-V_100m/S5_TOC_100_m_C1',
'Proba-V-S5-TOC-NDVI': 'http://www.vito-eodata.be/PDF/datapool/Free_Data/PROBA-V_100m/S5_TOC_NDVI_100_m_C1'
}
Two features that stand out are:
- it uses an async crawler bundled in the package itsybitsy
- it allows to download products concurrently with a ThreadPoolExecutor
Concurrent downloading is already mentioned in #146