rgbds icon indicating copy to clipboard operation
rgbds copied to clipboard

Improve tests and testing infrastructure

Open AntonioND opened this issue 8 years ago • 2 comments

The current way of doing regression tests is quite crude, it has to be improved. Also, there are not enough tests, there are many things of the toolchain that aren't tested and could potentially break.

AntonioND avatar Apr 02 '17 16:04 AntonioND

https://blog.travis-ci.com/2018-10-11-windows-early-release

AntonioND avatar Oct 11 '18 21:10 AntonioND

I think that ideally the CI scripts should run all tests individually (maybe each test can be in a folder) and it could keep track of the number of passing/failed tests, for example.

AntonioND avatar Sep 19 '20 15:09 AntonioND

I think this can be closed now...

AntonioND avatar Mar 16 '23 12:03 AntonioND

I don't know, the infrastructure is still kind of crude—the amount of failed tests is not reported, and their output tends to be drowned in the reports of passing tests.

ISSOtm avatar Mar 17 '23 19:03 ISSOtm

I used to think that bash wasn't the right language here, but now I think it actually makes sense because of how much the output is compared to reference data in files. At most, you could replace it by some python scripts, I guess.

AntonioND avatar Mar 17 '23 19:03 AntonioND

That much I agree with, though for rsgbds I think I will instead make a test runner in Rust that walks through all of the test cases.

ISSOtm avatar Mar 17 '23 19:03 ISSOtm