zarr-python icon indicating copy to clipboard operation
zarr-python copied to clipboard

[v3] Test environments and CI

Open jhamman opened this issue 1 year ago • 7 comments

We just merged #1592 which should make managing our various test environments much easier going forward. This ticket lays out a number of small tasks that can be taken to modernize our test environments and GitHub Actions Workflows. I'm sure I'm missing a few things here so feel free to comment / suggest alternatives.

Hatch related improvements

  • [x] Define dev environments in pyproject.toml using Hatch environments
    • Move requirements_dev_*.txt defining separate environments for "minimal", "dev". These should include parameterizations over python versions (3.10 and 3.11).
    • Use these environments in our GitHub actions
  • [x] Split out "minimal" environment into two separate environments
    • Minimum supported versions of all dependencies (see #1616)
    • Minimal dependencies (latest versions)
  • [x] Create "docs" environment so developers can simply run: hatch run docs:serve

GitHub Actions related improvements

  • [x] Explore removing the need to install a conda environment, instead relying on pure hatch environments
  • [ ] Explore combining the "windows", "minimal", and "python-package" workflows into a single workflow
  • [x] Run Mypy checks in each matrix run in addition to our pre-commit script

jhamman avatar Feb 06 '24 16:02 jhamman

I want to help with this and am motivated to get it done by tomorrow in time for the Zarr sprint.

rabernat avatar Feb 06 '24 16:02 rabernat

Quick update here. @rabernat got a good start on an initial Hatch env / CI setup in #1650. Still more to do here thought so leaving this open with the flag: help wanted.

jhamman avatar Feb 06 '24 22:02 jhamman

I'm planning to work on this at the Zarr sprint today, unless Ryan or others already plan to

maxrjones avatar Feb 07 '24 16:02 maxrjones

FYI I think the initial task list in this issue is complete now that https://github.com/zarr-developers/zarr-python/pull/1728 is merged

maxrjones avatar Apr 18 '24 21:04 maxrjones

Yep, I think this can be closed

dstansby avatar Jun 28 '24 07:06 dstansby

Before we do, it would be nice to get a windows test environment up and running.

jhamman avatar Jul 02 '24 03:07 jhamman

After https://github.com/zarr-developers/zarr-python/pull/2423 and #2418 go in, the last thing here is to get some diversity in platform into the test suite. Would be good to get at least 1 windows and MacOS entry in the main test matrix.

jhamman avatar Oct 21 '24 04:10 jhamman