jobe icon indicating copy to clipboard operation
jobe copied to clipboard

Improve test perfomance granularity2

Open spetzreborn opened this issue 2 months ago • 0 comments

This is a follow-up from https://github.com/trampgeek/jobe/pull/68

We had reperformance issues and decided to install a new server to replace the old one. When testing the new server I wanted hard number to compare between the installations, but the new server was so much better that the testsubmit.py failed in new ways:

  1. It open to many connections so that the testing server OS did not allowed more open sockets. The program then misbehaved when trying to close the connections that was not open.

Solution: only close the connection if the there is a connection.

  1. Testing takes a lot of time first double until fail, and then bisect to an exact value. This was not a problem on the old server where the range was not that big, but on the new server the range to backtrack through needs to many step, and there is no need to get that exact number

Solution: Add timeout for the tests, and add how many bisect steps should be tried to get highest good number.

Regards

spetzreborn avatar Dec 13 '24 14:12 spetzreborn