UTBotCpp icon indicating copy to clipboard operation
UTBotCpp copied to clipboard

[BUG] Timeout from setting is not used during test generation

Open tyuldashev opened this issue 3 years ago • 3 comments

Description It seems that timeout set in VSCode extension settings is not applied during test generation. Or it covers another error.

To Reproduce Steps to reproduce the behavior:

  1. Open settings for UTBot extension
  2. Set "Timeout per Test" (and "Timeout per Function" just in case) to 600, which should be equal to 10min
  3. Run test generation on following code:
int arr_sum(int arr[], int N) {
    int sum = 0;
    int i = 0;
    while(i < N) {
        sum += arr[i];
    };
    return sum;
}

Expected behavior Tests are supposed to be generated or timeout happen in 10 minutes

Actual behavior Quite quickly (in about 30sec) one test is generated but description of the tests contains following line

namespace UTBot {
// Some tests for function 'arr_sum' were skipped, as execution of function is out of timeout.

tyuldashev avatar Sep 27 '22 13:09 tyuldashev

We have additional timeout inside UTBot --bcov-check-interval=8s

ladisgin avatar Nov 04 '22 09:11 ladisgin

I also encounter the same problem, have you solved it? @tyuldashev

hustmurphy avatar Mar 16 '23 03:03 hustmurphy

I use CLI test as command like "/root/utbot-release-2022.10.8/utbot_distr/server-install/utbot generate --test-timeout -1 --function-timeout -1 -p "src" function -f src/main.c --line-number 31". My function logic is simple,but struct is complex.

hustmurphy avatar Mar 16 '23 03:03 hustmurphy