[QE] Review build strategy on Github Actions

[adrianriobo]

Currently the gh action building the installer is basically building it from the PR branch, in case the main branch is ahead those changes are not included within the installer.

Should we build it after rebase with main?

[praveenkumar]

I think our PR tests should be rebase on main branch to make sure it doesn't have conflict around PR and main branch and we are sure once we merge it with main branch it will not break it.