Various test failures with 0.17.0

[mweinelt]

Hi, thanks for maintaining pytest-mpl.

On nixpkgs we are seeing a few test failures after upgrading from 0.16.1 to 0.17.0

pytest-mpl> FAILED tests/test_baseline_path.py::test_config[dir1-None-None-dir1-True] - AssertionError: assert {'passed': 0, 'skipped': 0, 'failed': 1, 'errors': 0...
pytest-mpl> FAILED tests/test_baseline_path.py::test_config[dir1-dir2-None-dir2-True] - AssertionError: assert {'passed': 0, 'skipped': 0, 'failed': 1, 'errors': 0...
pytest-mpl> FAILED tests/test_baseline_path.py::test_config[dir1-dir2-dir3-dir3-True] - AssertionError: assert {'passed': 0, 'skipped': 0, 'failed': 1, 'errors': 0...
pytest-mpl> FAILED tests/test_baseline_path.py::test_config[None-None-dir3-dir3-True] - AssertionError: assert {'passed': 0, 'skipped': 0, 'failed': 1, 'errors': 0...
pytest-mpl> FAILED tests/test_pytest_mpl.py::test_formats[png-True-False] - AssertionError: assert {'passed': 0, 'skipped': 0, 'failed': 1, 'errors': 0...
pytest-mpl> FAILED tests/test_results_always.py::test_config[None-None-False] - AssertionError: assert {'passed': 0, 'skipped': 0, 'failed': 1, 'errors': 0...
pytest-mpl> FAILED tests/test_results_always.py::test_config[True-None-True] - AssertionError: assert {'passed': 0, 'skipped': 0, 'failed': 1, 'errors': 0...
pytest-mpl> FAILED tests/test_results_always.py::test_config[False-None-False] - AssertionError: assert {'passed': 0, 'skipped': 0, 'failed': 1, 'errors': 0...
pytest-mpl> FAILED tests/test_results_always.py::test_config[False-True-True] - AssertionError: assert {'passed': 0, 'skipped': 0, 'failed': 1, 'errors': 0...
pytest-mpl> FAILED tests/test_results_always.py::test_config[True-True-True] - AssertionError: assert {'passed': 0, 'skipped': 0, 'failed': 1, 'errors': 0...
pytest-mpl> FAILED tests/test_use_full_test_name.py::test_config[None-None-test_mpl-True] - AssertionError: assert {'passed': 0, 'skipped': 0, 'failed': 1, 'errors': 0...
pytest-mpl> FAILED tests/test_use_full_test_name.py::test_config[False-None-test_mpl-True] - AssertionError: assert {'passed': 0, 'skipped': 0, 'failed': 1, 'errors': 0...
pytest-mpl> FAILED tests/test_use_full_test_name.py::test_config[True-None-test_config.TestClass.test_mpl-True] - AssertionError: assert {'passed': 0, 'skipped': 0, 'failed': 1, 'errors': 0...
pytest-mpl> FAILED tests/test_use_full_test_name.py::test_config[False-True-test_config.TestClass.test_mpl-True] - AssertionError: assert {'passed': 0, 'skipped': 0, 'failed': 1, 'errors': 0...
pytest-mpl> FAILED tests/test_use_full_test_name.py::test_config[None-True-test_config.TestClass.test_mpl-True] - AssertionError: assert {'passed': 0, 'skipped': 0, 'failed': 1, 'errors': 0...

Our dependencies are:

• matplotlib 3.8.3
• pillow 10.2.0
• jinja2 3.1.3
• pytest 8.0.2

Full test log: https://gist.github.com/mweinelt/bb668e03a56ba4f86cfc4b1bfe7c0294