A testimonial
This tool has proven its value, and we want to integrate it into our CI and use it continuously. Thanks to @JZuming for running it and reporting the findings!
- Alexey Milovidov, ClickHouse Inc.
@alexey-milovidov Thank you very much for your recognition to my new tool! I am happy it could help you.
However, TxCheck is not the tool I used to test ClickHouse. The new tool is derived from TxCheck but is not open-source yet. I am still developing the new tool and will submit a research paper based on the tool to a computer science conference. After that, I will open the source code of the tool and would like to help you integrate it into your CI if possible!
TxCheck is also good at finding bugs in DBMSs, but it focuses on finding bugs in transactions supports of DBMSs (but ClickHouse is not supported yet). The paper based on it has been accepted by OSDI 2023. This is the paper: https://jzuming.github.io/paper/osdi23-jiang.pdf
Dear @alexey-milovidov,
We are very happy to share with you the news that our paper on the tool we used to test ClickHouse has been accepted by OSDI 2024!
The paper is available on my homepage: https://jzuming.github.io/paper/osdi24-jiang.pdf
The tool, named EET, is open source at: https://github.com/JZuming/EET
I really thank you for triaging and fixing the bugs we reported, and hope our tool has improved the reliability of ClickHouse.
Best wishes, Zu-Ming Jiang