pangeo-forge-recipes
pangeo-forge-recipes copied to clipboard
Port EOOffshore CMEMS ASCAT REP and NRT recipes to use `beam-refactor` branch
Following approach in #445, this will port the CMEMS ASCAT REP and NRT recipes to use the beam-refactor
branch. It will involve writing at least one custom PTransform
for required Dataset
preprocessing.
It looks like two PTransform
classes will be required:
- Similar to the CCMP recipe, the first transform will preprocess each
Dataset
, including replacing the providedtime
coordinates.- For now, the preprocess function can be wrapped with
pangeo_forge_recipes.transforms._add_keys()
.
- For now, the preprocess function can be wrapped with
- The second transform will sort the
PCollection
using the updatedtime
coordinates. I still need to confirm the best approach here, but it's likely that it will update thePosition
in eachIndex
, something similar to what currently occurs inpangeo_forge_recipes.transforms.IndexItems
.
This might be a candidate for the proposed separate issue for migrating tutorials from notebooks -> scripts (with CI testing)