arkouda icon indicating copy to clipboard operation
arkouda copied to clipboard

Segmentation violation in parquet unit test

Open stress-tess opened this issue 2 years ago • 5 comments

We've seen signal 11 failures happen on UnitTestParquetCpp for those with arm64 architecture (verified by those on the team with apple silicon). But we're now seeing the same failure with a user running a linux desktop with x86_64 architecture. So I figured it would be a good idea to track this in an issue

@Ethan-DeBandi99 @bmcdonald3, for their awareness (and since both know more about hardware and parquet than me :) )

stress-tess avatar Jul 22 '22 20:07 stress-tess

I managed to track down where exactly this is coming from. The final function call, errors += testReadStrings(strFilename, strDsetname);.

I need to see if I can determine why this is causing a seg fault. I validated that removing this test and running all the others successfully completes.

Ethan-DeBandi99 avatar Aug 01 '22 21:08 Ethan-DeBandi99

I took the test code and moved it into a arkouda module and it ran fine without seg faulting. Maybe it has to do with the Chapel testing architecture? Going to step away from this for a while and come back.

Ethan-DeBandi99 avatar Aug 02 '22 18:08 Ethan-DeBandi99

Just curious, did you run all the unit tests in that module or just the failing one? It is possible that the stack being manipulated via the other functions is kind of creating a perfect storm where the tests only fail with the stack looking a certain way that requires the particular order of the tests being run, but this is something I haven't looked into at all and so that is just a wild speculation.

bmcdonald3 avatar Aug 02 '22 18:08 bmcdonald3

I did both. I ran it with everything, each individual and things grouped together. The only thing that fails (including the singular test) is when testReadStrings is run. I could also try adjusting the CHPL_TASKS and see if that does anything to alter the results.

Ethan-DeBandi99 avatar Aug 02 '22 18:08 Ethan-DeBandi99

I think I am satisfied with the investigation you have done, so don't feel the need to do it on my behalf, just a thought that I had that sounds like you have already considered.

bmcdonald3 avatar Aug 02 '22 18:08 bmcdonald3