stargz-snapshotter icon indicating copy to clipboard operation
stargz-snapshotter copied to clipboard

How can we help?

Open andrewrynhard opened this issue 6 years ago • 11 comments

This seems very appealing for usage in https://github.com/talos-systems/talos. I'm curious if there is any way we might be able to help? I would love to help bring this to a state where it is production ready.

andrewrynhard avatar Oct 09 '19 22:10 andrewrynhard

@andrewrynhard Thanks a lot for your interest!

Any contribution, discussion and bug reporting, etc. are welcome. The discussion is mainly on #3731@containerd.

Could I ask how do you intend to use this remote snapshotter for your products? Currently, we are on the discussion stage, so we keen to hear as many use cases to support as possible.

And I updated the TODO list on README. Currently, we are mainly working on containerd's side so we are very happy if you give remote-snapshotter specific issues i.e.:

  • Resiliency: Ensure all mounts are available on every Prepare() and report errors when unavailable.
  • Auth: Implement auth-related things and the credential management(under the discussion on #3731@containerd)
  • Performance: READ performance improvement
  • Availability: Especially on NW disconnection

ktock avatar Oct 10 '19 03:10 ktock

@andrewrynhard Are you still interested in this? Recently this snapshotter supports Kubernetes through CRI. Can we seek the way for the integration?

ktock avatar Apr 23 '20 07:04 ktock

@ktock awesome. I saw your blog post. I am interested in how we could. Sounds like we need to get the agent into the OS and then configure containerd to use it. Should be simple enough. Is the agent written in go? Is CGO used?

andrewrynhard avatar Apr 23 '20 07:04 andrewrynhard

awesome! It's written purly in Go.

ktock avatar Apr 23 '20 08:04 ktock

Perfect. The primary use case I see is to speed up the pull of the hyperkube image. We will have to create a stargz version of the image?

andrewrynhard avatar Apr 23 '20 08:04 andrewrynhard

Yes. You can use ctr-remote command for converting the original image into stargz and pushing it to registries.

ktock avatar Apr 23 '20 08:04 ktock

That may be the only issue I can see in getting adoption of this in Talos. Right now we point to the official hyperkube image. But, I think this could still be really neat to have. I will play with it and see how much it improves our boot times.

andrewrynhard avatar Apr 23 '20 08:04 andrewrynhard

We are seeing an issue for using cloud-provided registries(e.g. GCR). so if you are to try it with these registries, could you wait for #81 get merged? This will be merged today or tomorrow. DockerHub is well-tested so far.

ktock avatar Apr 23 '20 08:04 ktock

And thanks a lot for trying it out!

ktock avatar Apr 23 '20 08:04 ktock

Sounds good 👍

andrewrynhard avatar Apr 23 '20 08:04 andrewrynhard

@andrewrynhard #81 got merged so this should work with cloud-provided registries. Can you try it out? You can convert the hyperkube image by ctr-remote image optimize <HYPERKUBE-IMAGE-PAYH> <YOUR-REPOSITRY-IMAGE-PATH>.

ktock avatar Apr 24 '20 08:04 ktock