Project with huge image

[dstadelm]

Question

My Project requires a huge image > 140GB. We are programming FPGAs and the tools required for that are sadly that large.

My current Setup: I've got a local registry which contains the mentioned Image

My earthly config .earthly/config.yml is as follows

global:
  cache_size_mb: 200000
  buildkit_additional_config: |
    [registry."registry:5000"]
      http = true

My Eartfile looks like this:

VERSION 0.8
PROJECT SCS/VERSAL-DEMO

create:
  FROM registry:5000/vivado:2024.1
  WORKDIR /build
  COPY vivado/create_project.tcl vivado/.
  RUN vivado -nojournal -log vivado/create_project.log -mode batch -source vivado/create_project.tcl -tclargs vivado
  SAVE ARTIFACT vivado AS LOCAL build/project

The FROM step in this case takes around 15 minutes each time. I would have expected, that this would only take so long in the first run.

Is there a solution to this problem. Or can I stop my efforts exploring earthly, as this would be a total show stopper in our setup.

One thing I was considering is using a volume or a COPY of the large data that makes the pull from the registry so slow. That might help, but it feels like a unfortunate work around.

Regards Dave