rascal
rascal copied to clipboard
beginsAfter test fails once more (randomly)
Describe the bug
Error: [ERROR] Tests run: 5798, Failures: 0, Errors: 1, Skipped: 198, Time elapsed: 452.947 s <<< FAILURE! - in org.rascalmpl.test.AllSuiteParallel
Error: [ERROR] beginsAfter1: <13508,117>(org.rascalmpl.test.infrastructure.RascalJUnitParallelRecursiveTestRunner$ModuleTester) Time elapsed: 0.006 s <<< ERROR!
java.lang.Exception:
Test lang::rascal::tests::basic::Locations::beginsAfter1 failed due to
test returned false
Actual parameters:
int =>0
Taken from: https://github.com/usethesource/rascal/actions/runs/3345467043/attempts/1
This was an action run for a release tag that failed due to this function.
Error: [ERROR] Tests run: 5817, Failures: 0, Errors: 1, Skipped: 197, Time elapsed: 189.707 s <<< FAILURE! - in org.rascalmpl.test.AllSuiteParallel
Error: [ERROR] beginsAfter1: <13508,117>(org.rascalmpl.test.infrastructure.RascalJUnitParallelRecursiveTestRunner$ModuleTester) Time elapsed: 0 s <<< ERROR!
java.lang.Exception:
Test lang::rascal::tests::basic::Locations::beginsAfter1 failed due to
test returned false
Actual parameters:
int =>-1559710758
Failed during https://github.com/usethesource/rascal/actions/runs/4733580658
@PaulKlint if you have time, could you have a look? This failed a release accidentally again.
Here's another one (during a release): https://github.com/usethesource/rascal/actions/runs/5003114296/jobs/8964006146
Error: [ERROR] Tests run: 5849, Failures: 0, Errors: 1, Skipped: 199, Time elapsed: 168.441 s <<< FAILURE! - in org.rascalmpl.test.AllSuiteParallel
Error: [ERROR] beginsAfter1: <13508,[117](https://github.com/usethesource/rascal/actions/runs/5185932055/jobs/9346472945#step:9:118)>(org.rascalmpl.test.infrastructure.RascalJUnitParallelRecursiveTestRunner$ModuleTester) Time elapsed: 0.004 s <<< ERROR!
java.lang.Exception:
Test lang::rascal::tests::basic::Locations::beginsAfter1 failed due to
test returned false
Actual parameters:
int =>6
here we go again.
again: https://github.com/usethesource/rascal/actions/runs/5344293811
I have @ignore'd this test because it seems to always pop-up while I'm doing complex release bootstraps and it never has to do anything with what I'm doing.
@PaulKlint Let's pick this up again when we start un-ignoring more tests after the first compiler bootstrap?
Agreed, I have already spent hours on these tests and it is extremely hard to get them 100% right. Let's turn them off and switch to another testing strategy, e.g., instead of randomly generated loc, we could use fixed predefined constant ones.