Jacob Prince-Bieker
Jacob Prince-Bieker
That's just been added.
Processed data is currently being stored here: https://huggingface.co/datasets/openclimatefix/eumetsat-iodc although it will be eventually collated and pushed to the GCP Public Dataset
No, its currently filling in random timesteps from the whole archive, 2017-now. Once dagster has its external assets tracker thing, it'll be able to know what's on HF and we...
Hi, Somewhat, we want to add the ability to convert the native files from Himawari and GOES to Zarr with a similar format as the Google Public Dataset version of...
Hi, Yes, that is all correct! The smallest first task would probably be to use Goes2-go to add a download manager for GOES, or alternatively just download from the AWS...
> @jacobbieker Thanks for the steps. I tried taking a stab at it. The below code snippet can download the files from the goes. > > ``` > from goes2go.data...
Thanks for the PR! I'll look over it soon. For this architecture, we want it to be the same interface for getting all the different satellite imagery, so integrating it...
Yeah, no problem! Happy to have you help! The best place to put the processing code would probably be in `satip/utils.py`. The approach for adding support would be to download...
Yes, here is some example data: https://sftp.eumetsat.int/public/folder/UsCVknVOOkSyCdgpMimJNQ/User-Materials/Test-Data/MTG/MTG_FCI_L1C_RC72-20240113_TD-505_Feb2024/ which hopefully should help! The timeline for the full release is https://user.eumetsat.int/resources/user-guides/mtg-in-operations
Could you send a list of all the names? In general, we want to make a public archive of the data, so we would want all of the bands. At...