Ryan Abernathey
Ryan Abernathey
Fortunately I put some notes in the workflow script https://github.com/pangeo-forge/pangeo-forge-recipes/blob/4f8c0522c1395aaf15a820cfd637a1f1e76729b2/.github/workflows/tutorials.yaml#L44-L49 It looks like, if we really want this workflow to work in the most beautiful possible way (i.e. posting status...
Beam programming takes some getting used to, but once it clicks, it seems super elegant to me. > Is it reasonable to set some time aside in the regular meeting...
What are the pros and cons of using our own workflow vs. the RTD github action to generate previews? cc @jbusecke
I got a notification that RTD was authorized for this repo.
Thanks for posting Tom. This is indeed an important and very common use case we need to support.
Yes this seems clearly like a gcsfs-level issue to me. At the Pangeo Forge level, this would be a perfect use case for https://github.com/zarr-developers/zarr-specs/issues/154. With an iceberg-style data lake, you...
The FSMap vs FSStore problem is really confusing. As a first step towards resolving it, I made https://github.com/zarr-developers/zarr-python/pull/911, which allows you to create an FSStore from an already-instantiated filesystem. There...
> Can we tag a release with this fix (`0.9.1`)? Is this something that I can do? Yes! Once you accept the invite to join the pangeo-forge org (already expired...
> * zarr requires regular chunking throughout. This is up for discussion in the zarr v3 spec (https://github.com/zarr-developers/zarr-specs/issues/40) > * astro coordinates (for example) map poorly to the xarray model...
Appending is significantly more complicated for the case discussed in #50: variable items per input. In this case, we don't know the size of the target dataset from the outset,...