lifecycle icon indicating copy to clipboard operation
lifecycle copied to clipboard

Published 20 hours ago • verified publisher icon buildpacks

Feature Request: Support exporting images to a containerd socket

Open spkane opened this issue 3 years ago • 7 comments

Description

It is more and more common not to have a local Docker daemon available and during certain testing cycles pushing to a registry is not always easy or desirable.

It would be great if you could easily create a buildpack and then export the results directly into a containerd namespace.

Proposed solution

Extend pack and the underlying creator command so that it is possible to pass in something like -containerd k8s.io, which will then tell the export step to push the results into that containerd namespace instead of into a Docker registry or daemon.

Describe alternatives you've considered

Many hacks that require running Docker, exporting to docker, pull out the image, and then re-pushing it into containerd.

spkane avatar Mar 16 '22 20:03 spkane

Cross-posted here: https://github.com/buildpacks/pack/issues/1393

Feel free to close one or the other, but I wasn't sure which location was best, and whether both tools would need related changes.

spkane avatar Mar 16 '22 20:03 spkane

Hi @spkane, Thanks for creating the issue! I've been working on a couple of RFCs related to adding additional support for removing the Daemon or exporting to OCI format.

  • https://github.com/buildpacks/rfcs/pull/203
  • https://github.com/buildpacks/rfcs/pull/201

I will try to take this issue into the evaluation and see if we can move forward with the idea!

jjbustamante avatar Mar 16 '22 20:03 jjbustamante

Thank you very much @jjbustamante ! That would be very much appreciated.

spkane avatar Mar 16 '22 21:03 spkane

With export to OCI layout supported in lifecycle 0.17.0, this is no longer blocked. We should research if we can use OCI layout as intermediate glue to export to the containerd socket. This research would probably need to be done in partnership with some folks from pack.

natalieparellano avatar Aug 14 '23 15:08 natalieparellano

cc @jjbustamante

natalieparellano avatar Aug 14 '23 15:08 natalieparellano

See https://github.com/buildpacks/pack/issues/1519#issuecomment-1808518168 - we have a short-term hack that degrades performance, but refactoring imgutil/local to use imgutil/layout/sparse will solve this cleanly.

natalieparellano avatar Nov 13 '23 16:11 natalieparellano

See buildpacks/pack#1519 (comment) - we have a short-term hack that degrades performance, but refactoring imgutil/local to use imgutil/layout/sparse will solve this cleanly.

Do we need to fix this issue first?

jjbustamante avatar Nov 14 '23 15:11 jjbustamante