peloton icon indicating copy to clipboard operation
peloton copied to clipboard

Long Running Test Cases

Open apavlo opened this issue 6 years ago • 1 comments

We need to create a new class of test cases (a mix of C++ gtest and Java junit) that run for long periods of time. I don't know what the right way to do this in terms of both build/test infrastructure (jenkins) and in the source code.

We should always be building these test cases as part of the regular build process but we don't want these to run when someone invokes make check. There might be a way to label tests as "long running" in C++ just by the class name (e.g., LongTest versus Test).

The long running tests should be running all the time in Jenkins. It can just run on the master branch. When one test finishes, it should automatically fire up the next one. If a test run fails, it should send an email to the mailing list.

The first test case should be a test that hammers the Bw-Tree index for hours (e.g., insert 1b keys, delete 1b keys, repeat). We should also run @tli2's fuzz tester in this manner as well.

apavlo avatar May 30 '18 14:05 apavlo

Got it. I'll start on this soon.

crd477 avatar May 30 '18 19:05 crd477