[FEATURE REQUEST] Add support for alternative file URLs to download-requirements

[przemyslavic]

Is your feature request related to a problem? Please describe. The download speed of Ignite binary from current link is very slow ~100KB/s, therefore it takes about an hour just to download a 400MB file.

Describe the solution you'd like Mirrors are available only for the latest version (and alpha): https://dist.apache.org/repos/dist/release/ignite/

More info: https://infra.apache.org/mirrors.html

Older versions are not mirrored (available at separate archive URL): https://archive.apache.org/dist/ignite/2.9.0/apache-ignite-2.9.0-bin.zip

We can introduce an improvement such as:

1. For latest version, one can define two links in requirements.txt

• main # mirrored (fast)
• alternative # archived (slow)

2. Test whether main link works
3. If the test succeeds, use main link, otherwise use alternative

NOTE: Solution should be generic (should work for other Apache provided files as well).

Additional context Official Ignite page: https://ignite.apache.org/download.cgi#binaries Official link to Ignite binary: with download speed ~3MB/s.

Alternative solution Use deb/rpm packages instead of zip file: https://ignite.apache.org/docs/latest/installation/deb-rpm

---

DoD checklist

• Changelog
  • [ ] updated
  • [ ] not needed
• COMPONENTS.md
  • [ ] updated
  • [ ] not needed
• Schema
  • [ ] updated
  • [ ] not needed
• Backport tasks
  • [ ] created
  • [ ] not needed
• Documentation
  • [ ] added
  • [ ] updated
  • [ ] not needed
• [ ] Feature has automated tests
• [ ] Automated tests passed (QA pipelines)
  • [ ] apply
  • [ ] upgrade
  • [ ] backup/restore
• [ ] Idempotency tested
• [ ] All conversations in PR resolved
• [ ] Solution meets requirements and is done according to design doc
• [ ] Usage compliant with license

[seriva]

Moved back to grooming after this PR discussion here about speed and redundancy for download links:

https://github.com/epiphany-platform/epiphany/pull/2091

[przemyslavic]

As commented in PR, the download speed seems to be back to normal now :)

[rpudlowski93]

@seriva Should we close the task? As I can see, the download mirror was changed in the mentioned PR or we want something else here?

[mkyc]

PR was not merged but closed, so I assume this task is intended to be changed into something more like "allow multiple download urls".

[seriva]

Updated this to reflect the new download-requirements in 2.0. We will not bother implementing this backwards.