Feature Request - Make manifest customizable for Kubernetes driver

[diego-maravankin]

Hi guys! First of all, I'd like to thank you for this great tool, it makes it really easy for remote image building in a Kubernetes cluster.

It would be great if buildx allowed the user to customize the manifest used to generate the deployment. My main interests are:

• resource limits, to avoid the situation where a build might affect other workloads in the kubernetes node. I am aware that this might lead to a build failure.
• the possibility to add tolerations to the pods, so that I can taint a node to use it exclusively for image building (combinig the toleration with the currently supported nodeSelector configuration) and not affecting other workloads in the kubernetes node.

Thanks guys for this awesome tool!

Diego

[paulbsch]

It would be especially helpful if there were a kubernetes driver opt for toleration(s) to coincide with the already available nodeselector option.

[zfalen-deloitte]

+1 for this. Taint / toleration options are key, resource limits would be nice

[crazy-max]

~Fixed by https://github.com/docker/buildx/pull/618~

[runcloudone]

+1 Really this is very important, ti think a lot of people would appreciate it if you add this option

[therapy-lf]

That's very useful

[ebdekock]

Would love it if we could get this!