Framework

[bleichenbacher-daniel]

In https://github.com/C2SP/wycheproof/issues/113#issuecomment-2042278642 a framework was announced and described as "work in progress". To my knowledge no details about this framework has ever been published. Hence it is very unclear where these efforts stand and how much is still needed to complete this. Can we learn the progress already made and see what is still needed?

The reason why I ask is that I have a number of new tests written against a variety of libraries (mostly, rust, python and javascript) and that it would make sense to organize these tests and combine them with the tests written for Wycheproof (i.e. Java and C++).

Additionally, I would be open to contribute to alternative projects that collect and organize test results (E.g. something like cargo-crev but for automatic testing).

[jedisct1]

As a quick and simple alternative to a review system, a web page maintaining an up-to-date list of implementations that include the Rooterberg/Wycheproof test vectors in their test suites (along with details about the language, algorithms, versions of test vectors, etc.) would be very useful.

[bleichenbacher-daniel]

I've added a list of tests sorted by library is here: https://github.com/bleichenbacher-daniel/Rooterberg/blob/main/tables/libraries.json

The main issue I have is that I don't know if that fits into the framework for Wycheproof assuming that such an effort exists.

[cpu]

I think the direction of C2SP/wycheproof has been clarified at this point.