James Bourbeau

Nightly CI job that opens an issue on test failures

1

It'd be nice if `dask-kubernetes` had a nightly CI job that opened an issue if a test failure occurs. Since the `main` branch of `dask` and `distributed` are already used,...

Remove binder?

1

Each PR gets a comment like this one https://github.com/nsidc/earthaccess/pull/397#issuecomment-1841113333 with a binder link. Though it looks like the binder is build is broken (see [this build](https://mybinder.org/v2/gh/jrbourbeau/earthaccess/f8cafefb8e1c9950fe2837e0e57e819cb9f2b32e) for an example). I'll...

Error downloading S3 file from SEA_SURFACE_HEIGHT_ALT_GRIDS_L4_2SATS_5DAY_6THDEG_V_JPL2205 dataset

6

Downloading HTTPS files with ```python import earthaccess results = earthaccess.search_data( short_name="SEA_SURFACE_HEIGHT_ALT_GRIDS_L4_2SATS_5DAY_6THDEG_V_JPL2205", count=10 ) files = results[0].data_links(access="indirect") out = earthaccess.download(files, "testdownload") print(f"{out = }") ``` works as expected with output ```...

Squash merge?

11

I don't feel super strongly, but have a mild preference for using squash merging on most projects. This makes it so contributors don't have to be careful with individual commits...

Consider using ``pre-commit`` hooks for linting

5

Sometimes it's easy to forget to lint code (I do this all the time!) and then CI builds fail because, for example, `black` isn't happy. We might consider using `pre-commit`...

Following up on https://github.com/nsidc/earthaccess/pull/318#discussion_r1360931257 > I'm not sure why we have separate access and in_region kwargs for determining if we want to use s3 or https urls. Is one kwarg...

[DNM] Allow for opening with known file sizes

5

The latest release of `s3fs` allows you to specify the file size ahead of time (if known) when opening an S3 file (this already existed for HTTPS files). This allows...

Opening lots of files can be slow

2

When I open a file on S3 like this: ```python import fsspec fs = fsspec.filesystem('s3', anon=True) path = "coiled-datasets/uber-lyft-tlc/part.93.parquet" fs.open(path, mode="rb") ``` The `fs.open` call often takes ~0.5-1.5 seconds to...

Dask User Survey 2022

15

It'd be great to continue the Dask user survey we've done the past few years (xref https://github.com/dask/community/issues/148, https://github.com/dask/community/issues/56) @TomAugspurger this is something you've historically helped with. Do you have bandwidth...

Policy for minimum versions on dependencies

3

There's a [discussion over in the Dask issue tracker](https://github.com/dask/dask/issues/7378) around adopting a new policy for the minimum version of dependencies Dask should support. Currently the proposal is "we support versions...