Explore alternatives to using the cache

[gurevichdmitry]

Motivation

To improve our workflows and reduce complexity, we want to investigate alternative methods for working with jobs data (build artifacts, docker images) instead of relying solely on caching. The goal of this task is to research and assess alternative methods for saving and retrieving artifacts in our workflow, with a particular focus on uploading them to Artifactory.

For insights on optimizing tasks, consider referring to this article on comparing artifacts and dependency caching.

Definition of done

• [ ] Assess the technical feasibility and benefits of integrating Artifactory for saving and retrieving artifacts vs cache usage

Out of scope

The implementation of Artifactory in workflows is not within the scope of this assessment.

Related tasks/epics

[orestisfl]

Related to https://github.com/elastic/cloudbeat/issues/1175

Last time we looked with @oren-zohar some of the caches are only used once