xarray icon indicating copy to clipboard operation
xarray copied to clipboard

⚠️ Nightly upstream-dev CI failed ⚠️

Open github-actions[bot] opened this issue 1 year ago • 5 comments

Workflow Run URL

Python 3.12 Test Summary
xarray/tests/test_groupby.py::test_gappy_resample_reductions[any]: IndexError: bool index 1 has shape (11,) instead of (13,)
xarray/tests/test_groupby.py::test_gappy_resample_reductions[all]: IndexError: bool index 1 has shape (11,) instead of (13,)
xarray/tests/test_groupby.py::test_gappy_resample_reductions[count]: IndexError: bool index 1 has shape (11,) instead of (13,)
xarray/tests/test_plugins.py::test_list_engines: AssertionError: assert ('zarr' in {'h5netcdf': <H5netcdfBackendEntrypoint>\n  Open netCDF (.nc, .nc4 and .cdf) and most HDF5 files using h5netcdf in Xarr...in Xarray\n  Learn more at https://docs.xarray.dev/en/stable/generated/xarray.backends.ScipyBackendEntrypoint.html, ...}) == False

github-actions[bot] avatar Jul 25 '24 00:07 github-actions[bot]

Lots of failures!

dcherian avatar Aug 07 '24 04:08 dcherian

The failures below all happen to be fixed by https://github.com/pydata/xarray/pull/9403 (see for example this upstream CI run):

xarray/tests/test_variable.py::TestVariable::test_datetime64_conversion_scalar: AssertionError: assert dtype('<M8[D]') == dtype('<M8[ns]')
 +  where dtype('<M8[D]') = <xarray.Variable ()> Size: 8B\nnp.datetime64('2000-01-01').dtype
 +  and   dtype('<M8[ns]') = <class 'numpy.dtype'>('datetime64[ns]')
 +    where <class 'numpy.dtype'> = np.dtype
xarray/tests/test_variable.py::TestVariable::test_timedelta64_conversion_scalar: AssertionError: assert dtype('<m8[D]') == dtype('<m8[ns]')
 +  where dtype('<m8[D]') = <xarray.Variable ()> Size: 8B\nnp.timedelta64(1,'D').dtype
 +  and   dtype('<m8[ns]') = <class 'numpy.dtype'>('timedelta64[ns]')
 +    where <class 'numpy.dtype'> = np.dtype
xarray/tests/test_variable.py::TestVariable::test_0d_timedelta: AssertionError: assert dtype('<m8[s]') == dtype('<m8[ns]')
 +  where dtype('<m8[s]') = <xarray.Variable ()> Size: 8B\nnp.timedelta64(1,'s').dtype
 +  and   dtype('<m8[ns]') = <class 'numpy.dtype'>('timedelta64[ns]')
 +    where <class 'numpy.dtype'> = np.dtype
xarray/tests/test_variable.py::TestVariable::test_index_0d_numpy_string: TypeError: byte indices must be integers or slices, not tuple
xarray/tests/test_variable.py::TestAsCompatibleData::test_datetime: AssertionError: assert <class 'numpy.ndarray'> is <class 'numpy.datetime64'>
 +  where <class 'numpy.ndarray'> = np.ndarray
 +  and   <class 'numpy.datetime64'> = type(np.datetime64('2000-01-01'))
xarray/tests/test_variable.py::test_datetime_conversion_warning[2000-01-01T00:00:00-True]: Failed: DID NOT WARN. No warnings of type (<class 'UserWarning'>,) were emitted.
 Emitted warnings: [].
xarray/tests/test_variable.py::test_timedelta_conversion_warning[10 seconds-True]: Failed: DID NOT WARN. No warnings of type (<class 'UserWarning'>,) were emitted.
 Emitted warnings: [].

spencerkclark avatar Sep 01 '24 12:09 spencerkclark

New h5netcdf errors are due to upstream changes. I'll fix this as soon as possible.

Update: #9509

kmuehlbauer avatar Sep 07 '24 06:09 kmuehlbauer

@dcherian, there's a new groupby failure:

xarray/tests/test_groupby.py::test_gappy_resample_reductions[any]: IndexError: bool index 1 has shape (11,) instead of (13,)

Do you have any idea about what could cause this?

keewis avatar Sep 22 '24 11:09 keewis

looks like there's a upcoming change to scipy.sparse that causes flox to break. Not sure what exactly, but this should be fixed within flox.

Edit: looks like it's the same as xarray-contrib/flox#369

keewis avatar Oct 05 '24 22:10 keewis

@pydata/xarray are any of these failures blocking us from releasing? I'm itching to release both xarray.DataTree (tracked here https://github.com/pydata/xarray/issues/8572#issuecomment-2436055217) and zarr-python v3 compatibility.

TomNicholas avatar Oct 24 '24 18:10 TomNicholas

zarr might be fixed by #9673, and the failing gappy tests will have to be fixed in flox (the issue is a change in upstream-dev scipy.sparse).

I think since the PR for zarr is there we should wait on that, but no need to wait on fixes for flox.

keewis avatar Oct 24 '24 18:10 keewis

Filed https://github.com/scipy/scipy/issues/21747

dcherian avatar Oct 24 '24 19:10 dcherian

we've got a couple new errors related to zarr (first seen two days ago):

xarray/tests/test_backends.py::TestZarrDictStore::test_manual_chunk[2]: ValueError: ndarray is not C-contiguous
xarray/tests/test_backends.py::TestZarrDictStore::test_warning_on_bad_chunks[2]: Failed: DID NOT WARN. No warnings of type (<class 'UserWarning'>,) were emitted.
 Emitted warnings: [].
xarray/tests/test_backends.py::TestZarrDictStore::test_write_uneven_dask_chunks[2]: ValueError: ndarray is not C-contiguous
xarray/tests/test_backends.py::TestZarrDictStore::test_encoding_chunksizes[2]: ValueError: ndarray is not C-contiguous
xarray/tests/test_backends.py::TestZarrDirectoryStore::test_manual_chunk[2]: ValueError: ndarray is not C-contiguous
xarray/tests/test_backends.py::TestZarrDirectoryStore::test_warning_on_bad_chunks[2]: Failed: DID NOT WARN. No warnings of type (<class 'UserWarning'>,) were emitted.
 Emitted warnings: [].
xarray/tests/test_backends.py::TestZarrDirectoryStore::test_write_uneven_dask_chunks[2]: ValueError: ndarray is not C-contiguous
xarray/tests/test_backends.py::TestZarrDirectoryStore::test_encoding_chunksizes[2]: ValueError: ndarray is not C-contiguous
xarray/tests/test_backends.py::TestZarrWriteEmpty::test_manual_chunk[2]: ValueError: ndarray is not C-contiguous
xarray/tests/test_backends.py::TestZarrWriteEmpty::test_warning_on_bad_chunks[2]: Failed: DID NOT WARN. No warnings of type (<class 'UserWarning'>,) were emitted.
 Emitted warnings: [].
xarray/tests/test_backends.py::TestZarrWriteEmpty::test_write_uneven_dask_chunks[2]: ValueError: ndarray is not C-contiguous
xarray/tests/test_backends.py::TestZarrWriteEmpty::test_encoding_chunksizes[2]: ValueError: ndarray is not C-contiguous

cc @jhamman

keewis avatar Oct 26 '24 17:10 keewis

Some new errors related to zarr:

TypeError: MemoryStore.__init__() got an unexpected keyword argument 'mode'

headtr1ck avatar Nov 16 '24 10:11 headtr1ck