Charles Stern
Charles Stern
@sharkinsspatial, moving to running from an automatically-built `@latest` image makes sense to me. > ADR 2 specifies that the pangeo-forge-recipes version is given in meta.yaml. This line from @rabernat's opening...
Thanks for this proposal, @RobertPincus. If I understand correctly, there are at least two related (but distinct) goals outlined here: 1. Creating a mirror of the complete dataset(s) in some...
@RobertPincus thanks for the clarification. [Here is the documentation](https://pangeo-forge.readthedocs.io/en/latest/pangeo_forge_cloud/recipe_contribution.html#required-files) on recipe contribution. (This published just this morning, so if anything doesn't make sense, that's my fault! Please let me know...
The html page is back up. Inspecting the source there reveals that appending `.dap.nc4` is the path to direct download: ```html ``` Amending the earlier `make_url` function accordingly, I can...
Yes, that's the code block which aims to download the file. How did you get this 40 MB `MCD06COSP_M3_MODIS.A2021182.061.2021250210032.nc`? When I navigate to the GUI at > https://ladsweb.modaps.eosdis.nasa.gov/opendap/hyrax/allData/61/MCD06COSP_M3_MODIS/2002/182/MCD06COSP_M3_MODIS.A2002182.061.2020181145824.nc.dmr.html and click...
... hmm on closer reading your file has an `updated_at` slug of `2021250210032` whereas somehow I'm pointing at `2020181145824` which is an older version... I'm going to look into that...
Thanks for these helpful clarifications re: expected data size, Robert. I've made considerable headway with both file retrieval and a draft of the recipes themselves. Buckle up for a longish...
Yes, merging is definitely the way to go. As Ryan said, we'll need https://github.com/pangeo-forge/pangeo-forge-recipes/pull/245 to do this in a single recipe, but we _can_ do it today in two steps,...
> here's a lot to be gained by more targeted processing. ... My understanding is that I should create a set of dictionary containing a set of XarrayZarrRecipes, where each...
> I'm not sure how y'all think of things at Pangeo-forge but, from a science user's perspective, there's a lot to be gained by more targeted processing. Last comment for...