kickstart-tests icon indicating copy to clipboard operation
kickstart-tests copied to clipboard

Make tests requiring iso with payload (DVD iso) reliable running in reasonable time (reduce DVD fetch time)

Open rvykydal opened this issue 3 years ago • 7 comments

We are seeing s lot of flakes on Fedora where we are using Server DVD: https://github.com/rhinstaller/kickstart-tests/issues/694

For RHEL the production DVD is huge (~9 GB), the download time exceeds the test timeout.

These tests are involved: https://github.com/rhinstaller/kickstart-tests/blob/master/harddrive-install-tree.sh - disabled on RHEL https://github.com/rhinstaller/kickstart-tests/blob/master/harddrive-install-tree-relative.sh - disabled on RHEL https://github.com/rhinstaller/kickstart-tests/blob/master/harddrive-iso.sh - disabled by not being executable https://github.com/rhinstaller/kickstart-tests/blob/master/repo-addrepo-hd-tree.sh - disabled because of https://github.com/rhinstaller/kickstart-tests/issues/790 https://github.com/rhinstaller/kickstart-tests/blob/master/repo-addrepo-hd-iso.sh

rvykydal avatar Sep 27 '22 13:09 rvykydal

The plan is to pre-create and use a fake ISO with a repository generated by the generate-repository.py script. The actual content can be always provided by an additional installation source. We already use that trick in some of the kickstart tests.

poncovka avatar Sep 27 '22 13:09 poncovka

Status update: we haven't seen the flake in our dailies since 10/18/2022 (20 days).

rvykydal avatar Nov 07 '22 10:11 rvykydal

We should probably split ISO generation with the test execution. Like cockpit does. In that case we would be able to gate them "easily".

jkonecny12 avatar Nov 21 '22 10:11 jkonecny12

We should probably split ISO generation with the test execution. Like cockpit does. In that case we would be able to gate them "easily".

We don't have to gate them at all if there are no real packages on them.

poncovka avatar Nov 21 '22 10:11 poncovka

Disabling repo-addrepo-hd-tree on rhel10: https://github.com/rhinstaller/kickstart-tests/pull/1089

rvykydal avatar Mar 21 '24 08:03 rvykydal

Disabling on rhel, enabling on Fedora: https://github.com/rhinstaller/kickstart-tests/pull/1145

rvykydal avatar Apr 29 '24 08:04 rvykydal

Marking all the tests with "harddrive" tag in https://github.com/rhinstaller/kickstart-tests/pull/1210

rvykydal avatar May 31 '24 10:05 rvykydal