keyman icon indicating copy to clipboard operation
keyman copied to clipboard

feat(core): cache opportunities for ICU downloads, etc 🙀

Open srl295 opened this issue 2 years ago • 2 comments

in re #8495 : look at how to cache the meson data on the build agents across builds

srl295 avatar Sep 01 '23 01:09 srl295

https://build.palaso.org/buildConfiguration/Keyman_Common_KPAPI_TestPullRequests_macOS/431756?expandBuildDeploymentsSection=false&hideTestsFromDependencies=false&hideProblemsFromDependencies=false&expandBuildProblemsSection=true&expandBuildChangesSection=true had:

Downloading icu-for-uset source from https://github.com/unicode-org/icu/releases/download/release-73-1/icu4c-73_1-src.tgz
<urlopen error [Errno 60] Operation timed out>
[10:24:22 ]  A fallback URL could be specified using source_fallback_url key in the wrap file
[10:24:22 ]  
[10:24:22 ](https://build.palaso.org/buildConfiguration/Keyman_Common_KPAPI_TestPullRequests_macOS/4317  src/meson.build:59:0: ERROR: could not get https://github.com/unicode-org/icu/releases/download/release-73-1/icu4c-73_1-src.tgz is the internet available?

26M file, doesn't change from build to build. Caching would prevent this from being downloaded (twice??)

./developer/src/kmcmplib/subprojects/packagecache/icu4c-73_1-src.tgz
./core/subprojects/packagecache/icu4c-73_1-src.tgz
  • meson 1.3.0 has a MESON_PACKAGE_CACHE_DIR that would be great because there could be a single persistent dir outside of the workspace that holds the cached files.

srl295 avatar Dec 19 '23 16:12 srl295

MESON_PACKAGE_CACHE_DIR=${HOME}/Downloads/packagecache works well globally with meson 1.3.0, allows sharing between keyman builds locally so I just set this in my local environment globally

srl295 avatar Dec 22 '23 22:12 srl295

can we simply set MESON_PACKAGE_CACHE_DIR to something persistent on the build servers?

srl295 avatar May 02 '24 22:05 srl295

I can look at adding this to our build agents.

mcdurdin avatar May 03 '24 02:05 mcdurdin