jobe
jobe copied to clipboard
Improve test perfomance granularity2
This is a follow-up from https://github.com/trampgeek/jobe/pull/68
We had reperformance issues and decided to install a new server to replace the old one. When testing the new server I wanted hard number to compare between the installations, but the new server was so much better that the testsubmit.py failed in new ways:
- It open to many connections so that the testing server OS did not allowed more open sockets. The program then misbehaved when trying to close the connections that was not open.
Solution: only close the connection if the there is a connection.
- Testing takes a lot of time first double until fail, and then bisect to an exact value. This was not a problem on the old server where the range was not that big, but on the new server the range to backtrack through needs to many step, and there is no need to get that exact number
Solution: Add timeout for the tests, and add how many bisect steps should be tried to get highest good number.
Regards