Tom White

Delayed-like functionality

1

There are some cases where it would be useful to have a way of setting up a parallel map over inputs, then calling `compute` on it later - like Dask...

Implement something like `raise_if_cubed_computes` similar to xarray's [`raise_if_dask_computes`](https://github.com/pydata/xarray/blob/8c21376aa94deb91cb10e78f56ecd68aa7fe90fa/xarray/tests/__init__.py#L125-L130)

Change Coiled executor to use Dask async API

1

It would be nice if we could change `CoiledFunctionsDagExecutor` to be similar to (or based on) `AsyncDaskDistributedExecutor`, as it would then inherit all the features of that latter, like retries,...

Lithops uses an async programming model, but not Python asyncio. It would be nice if we could bridge the two, as then we'd be able to use the common asyncio...

It should run in CI too, like the Modal one does.

Add a GH Actions workflow that runs Cubed tests using Zarr V3 storage. This will ensure that the upcoming work to update Zarr to support the V3 spec (see https://github.com/zarr-developers/zarr-python/discussions/1480)...

Executor feature comparison

6

(I wrote this to help track what works needs to be done on the executors, but it might be useful to add to the user docs at some point.) This...

Consider a simple blockwise operation with one input, where each task carries out the following steps: 1. read compressed Zarr chunk 2. decompress Zarr chunk to produce the input array...

See https://github.com/tomwhite/cubed/issues/284#issuecomment-1660425647

Calculating the cost of a computation

2

It would be useful to provide numbers for actual resources used after a computation is complete so its cost can be calculated. We probably need: 1. total worker seconds 2....