Compilation of bugs with multiple submodules

[jose]

trafficstars

Hi @nus-apr,

In the context of another project, I've noticed that all bugs in the Bugs.jar benchmark (except Commons-Math) are composed by multiple submodules. And I've also noticed that the root pom.xml of some bugs fail to compile but the true buggy submodule compiles successfully. Have you encountered such odd behaviour while compiling bugs with multiple submodules?

-- Best, Jose

[Marti2203]

Hi @jose , Yes, I have also exhibited this in multiple projects in the VUL4J benchmark. In Cerberus, this can be tracked with a better benchmark driver and additional benchmark metadata to allow for more precise state tracking.

[jose]

Thanks @Marti2203. Why don't we keep this issue open until the problem is formally addressed?

[rshariffdeen]

Hi @jose Thanks for opening the issue, Indeed I have encountered this in other benchmarks as well, for such instances we change the scope the build to the buggy module. In our meta data file we specify the submodule which should be built and tested. This we achieve via creating our own scripts, which we were able to do so in our own versions of the benchmark.

We may be able to do the same for the bugs.jar as well. Will update this thread when we have updated the benchmark.

[jose]

In our meta data file we specify the submodule which should be built and tested.

Ok.

Will update this thread when we have updated the benchmark.

Awesome, thanks.