Tom Augspurger
Tom Augspurger
In https://github.com/intake/intake-stac/blob/b1451497a6ea40b939f340e397fafad082fcc47a/intake_stac/catalog.py#L123, intake-stac will recurse into child objects. This will end up making many HTTP requests for large, dynamic STAC catalogs served over a STAC API like https://planetarycomputer.microsoft.com/api/stac/v1. I believe...
*Purely as a convenience*, it'd be nice to have a `StacCollection.search` method that uses `pystac-client` to search an endpoint with a specific collection. ```python cat = intake.open_stac_catalog("/path/to/catalog") collection = cat["my-collection"]...
### Dataset Name Daymet ### Dataset URL https://daymet.ornl.gov/ ### Description > Daymet provides long-term, continuous, gridded estimates of daily weather and climatology variables by interpolating and extrapolating ground-based observations through...
Until there's a reason not to?
Would it be helpful to standardize the ability to set the content type of files written by fsspec? Several backends have / are requesting the ability to set this (https://github.com/fsspec/s3fs/blob/4f289eaa34dfe8337a72f5a0148c41a44793fde0/s3fs/core.py#L971-L974,...
Currently, `ReferenceFileSystem` takes an argument `fo`: https://github.com/fsspec/filesystem_spec/blob/6233f315548b512ec379323f762b70764efeb92c/fsspec/implementations/reference.py#L66-L69 It's not clear to me what `fo` means. I understand that is the dictionary generated by kerchunk. Does that have a concrete name...
See https://github.com/dask/s3fs/pull/229. After that, the catching of Invalid ranges we do in https://github.com/dask/s3fs/blob/3825b7473312cbb3e7bc9196fbd46eefe3c4556b/s3fs/core.py#L1153-L1157 may be unnecessary.
Currently, translating HDF5 to Zarr will result in a Zarr store with identical chunks as the source. If the source isn't chunked, this will cause *worse* performance when you slice...
What are the required dependencies of kerchunk? Right now https://github.com/fsspec/kerchunk/blob/6b57f0620c9e1e55206523ac54dadf60830b0935/requirements.txt has ujson on fsspec. Working with HDF5 files (https://github.com/fsspec/kerchunk/blob/main/kerchunk/hdf.py) seems to require h5py, zarr (and numcodecs), and numpy. combine requires...
When you make a search, select and item, and pickle it, the bytestream will be (surprisingly) large. ```python import pystac_client import pystac catalog = pystac_client.Client.open("https://planetarycomputer.microsoft.com/api/stac/v1/") search = catalog.search(collections=["sentinel-2-l2a"], datetime="2022-09-01/2022-09-12", bbox=(68.1766451353734,...