style-analyzer icon indicating copy to clipboard operation
style-analyzer copied to clipboard

Scheduler for long running tests in travis

Open EgorBu opened this issue 7 years ago • 3 comments

Make a schedule to launch long-running tests during the weekends so we know if something is failing.

EgorBu avatar Nov 08 '18 11:11 EgorBu

@warenlg You should do this once you pass the long tests.

vmarkovtsev avatar Dec 19 '18 15:12 vmarkovtsev

To give some feedback on my experience last time I tried it:

  • travis has no option to schedule a cron at a given time every week. It is possible however to create the cron at the time you want and it should repeat in the future weeks around that time (this is obviously really annoying since it means doing it on a sunday for us)
  • last time I checked I saw 2 ways to enable long tests in the cron:
    • conditional stages or jobs, in particular there is a type = cron condition that should be usable to filter on crons only.
    • environment variables (TRAVIS_EVENT_TYPE is set to cron during cron jobs).
  • we should not hardcode anything in the tests themselves but rather edit .travis.yml to set LONG_TESTS appropriately with one method or the other.

m09 avatar Dec 19 '18 15:12 m09

I created a cron job to run weekly. I also added "do not run if there was a build in the last 24 hours". This should be fine for now. So what's left is to check TRAVIS_EVENT_TYPE in script and export LONG_TESTS=1 if in cron.

vmarkovtsev avatar Dec 19 '18 16:12 vmarkovtsev