"2 did not equal 0 make failed (TestGS.scala:75)"

[jjyuhub]

How to deal with these errors?

[info] - printfTestSymUninit *** FAILED *** [info] 2 did not equal 0 make failed (TestGS.scala:75) [info] Run completed in 23 seconds, 851 milliseconds. [info] Total number of tests run: 86 [info] Suites: completed 1, aborted 0 [info] Tests: succeeded 0, failed 86, canceled 0, ignored 0, pending 0

Single-threaded time: 13.46 seconds Multi-threaded time: 33.08 seconds Estimated speedup: 0.406892×

What commands do you exactly run to get the 9X speedups?

[Kraks]

Hi @jjyuhub, thanks for posting the issue. From the log you pasted here (succeeded 0, failed 86), it looks like none of the test cases were successfully executed. So I don't know how to interpret the numbers you posted here. Are you sure you have properly set up the environment?

In our ICSE paper, Section VII-C shows the details of the ~9x speedup of execution time (not including SMT solving time) with 12 threads. You could follow our reproduction instruction if you are curious.