Segfaulting tests with Catalina

[iiSeymour]

Running the test suite under the latest 10.15 beta results in a segfault.

$ python setup.py test
running pytest
Searching for Pillow
Best match: Pillow 6.1.0
Processing Pillow-6.1.0-py3.7-macosx-10.14-x86_64.egg

Searching for pytest-cov
Best match: pytest-cov 2.7.1
Processing pytest_cov-2.7.1-py3.7.egg

Searching for coverage>=4.4
Best match: coverage 5.0a6
Processing coverage-5.0a6-py3.7-macosx-10.14-x86_64.egg

running egg_info
writing onnx_coreml.egg-info/PKG-INFO
writing dependency_links to onnx_coreml.egg-info/dependency_links.txt
writing entry points to onnx_coreml.egg-info/entry_points.txt
writing requirements to onnx_coreml.egg-info/requires.txt
writing top-level names to onnx_coreml.egg-info/top_level.txt
reading manifest file 'onnx_coreml.egg-info/SOURCES.txt'
writing manifest file 'onnx_coreml.egg-info/SOURCES.txt'
running build_ext
================================ test session starts ================================
platform darwin -- Python 3.7.3, pytest-5.0.1, py-1.8.0, pluggy-0.12.0
plugins: cov-2.7.1
collected 2107 items                                                                

tests/convert_test.py ....                                                    [  0%]
tests/custom_layers_test.py ....                                              [  0%]
tests/graph_test.py ..                                                        [  0%]
tests/onnx_backend_models_test.py sssssssssssssssssssssssssssssssssssssssssss [  2%]
sssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssss [  6%]
sssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssss [  9%]
sssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssss [ 13%]
sssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssss [ 17%]
sssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssss [ 20%]
sssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssss [ 24%]
sssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssss [ 28%]
sssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssss [ 31%]
sssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssss [ 35%]
ssssssssssssssssssssssssssss.s.s.s.s.s.ssssssssssssssssssssssssssssssssssssss [ 39%]
sssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssss [ 42%]
sssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssss [ 46%]
sssssssssssssssssssssssssssssssssssssssssssssssssssssssss                     [ 49%]
tests/onnx_backend_node_test.py .sssssssssss.sssssssssssssssssss.s.s.s.s.sss. [ 51%]
s.s.s.s.sssssssssssssssss.s.s.s.s.s.s.s.s.s.s.sssssssssssssssssssssssssssssss [ 54%]
.s.s.s.s.s.s.s.sssssss.sss.s.s.s.sss.sssssssssssssssssssssssssssssssssss.s.ss [ 58%]
s.s.sssssssssssssss.s.s.s.sssssss.s.sssssssssss.s.sssss.sssssssssssss.s.s.s.s [ 62%]
ssssssssssssssssssssss.s.s.sssssssss.s.s.sssss.sssssssssss.s.s.s.ssssssssssss [ 65%]
s.s.s.s.s.s.s.s.s.s.s.s.sssssssssss.s.s.s.s.s.sss.s.sss.s.sssssssssssssssssss [ 69%]
ssssssssssssssssssssss.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.sssssssssssss.s.s.s. [ 73%]
s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.sssssssss [ 76%]
ssssssssssss.s.s.sssssssss.s.sssssssssssssssssss.s.s.s.sssssssssss.s.s.s.s.s. [ 80%]
s.s.s.sssssss.s.s.sss.s.s.s.s.sssss.s.sssssssssssssssFs.sssssssss.s.s.s.s.s.s [ 84%]
.s.sssssssssssssssssssssssssssssssssssssssssssssssssss.sssss.s.sssssssss.s.ss [ 87%]
sss.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.sssssssssssssss.s.s.sssss.s.s.s.s.s [ 91%]
.s.s.s.s.sssssss.sss.s.sssss.sss.s.s.s.s.s.s.s.s.s.s.sssssss.sss.sssssssss.ss [ 95%]
s.s.s.s.s.s.sss.s.s.sssFs.sFsssss.s.s.s.sssss.s.s.s.s.s                       [ 97%]
tests/operators_test.py Fatal Python error: [1]    
  53753 segmentation fault  python setup.py test

System Info

$ sw_vers
ProductName:    Mac OS X
ProductVersion: 10.15
BuildVersion:   19A512f
$ sysctl -n machdep.cpu.brand_string
Intel(R) Xeon(R) CPU E5-2697 v2 @ 2.70GHz

[iiSeymour]

I've identified the problematic test as tests/operators_test.py::SingleOperatorTest::test_avg_pool.

$ pytest tests/operators_test.py::SingleOperatorTest::test_avg_pool
================================ test session starts ================================
platform darwin -- Python 3.7.3, pytest-5.0.1, py-1.8.0, pluggy-0.12.0
cachedir: .pytest_cache
plugins: cov-2.7.1
collected 1 item                                                                    

tests/operators_test.py::SingleOperatorTest::test_avg_pool Fatal Python error: [1]
 56093 segmentation fault SingleOperatorTest::test_avg_pool

Excluding test_avg_pool the tests finish with the following results:

==== 10 failed, 308 passed, 1787 skipped, 1 xfailed, 4 warnings in 57.20 seconds ====

[aseemw]

Thank you @iiSeymour for finding the failure. Seems to be a bug in the CoreML framework when CPU backend is used, we will look into it.