[CI] Don't run E2E tests when only compile-time LIT tests changed

[sarnex]

Is your feature request related to a problem? Please describe

For example, https://github.com/intel/llvm/pull/14289

Describe the solution you would like

No response

Describe alternatives you have considered

No response

Additional context

No response