DOKS icon indicating copy to clipboard operation
DOKS copied to clipboard

NAT gateway (static ip)

Open klausenbusk opened this issue 5 years ago • 31 comments

This is probably more a general DO feature request than a k8s specific request.

We need static IPs for egress traffic as it makes it a lot easier for our customers to whitelist traffic from us. We are currently using a kubeadm cluster and some custom scripting to route all traffic through a single node (which has a floating ip).

Ideally we could use DOKS directly.

https://cloud.google.com/nat/docs/using-nat
https://docs.aws.amazon.com/vpc/latest/userguide/vpc-nat-gateway.html

klausenbusk avatar Jul 11 '19 19:07 klausenbusk

Hey @klausenbusk you are correct that this is more of a general DO feature than k8s specific, but it is a feature that is currently on the product roadmap for the networking team. Timelines can shift dramatically, but I think they are targetting early 2020. Would you be interested in a feature where you can pay to have staticIPs assigned to your nodes so that all your egress traffic keeps coming from the same IPs?

nathanjsweet avatar Jul 11 '19 20:07 nathanjsweet

Would you be interested in a feature where you can pay to have staticIPs assigned to your nodes so that all your egress traffic keeps coming from the same IPs?

Do you mean a staticIP per node or some sort of gateway so multiple nodes can use the same IP for egress traffic? If it is the latter then yes. Ideally I should be able to scale the cluster up or down, without the IP changing.

klausenbusk avatar Jul 11 '19 21:07 klausenbusk

Do you mean a staticIP per node

Yes.

or some sort of gateway so multiple nodes can use the same IP for egress traffic

No, but perhaps you could set this up with a service mesh of some kind in conjunction with us creating a staticIP feature.

nathanjsweet avatar Jul 12 '19 15:07 nathanjsweet

Hello, I'm the product manager for network at DO. Just to give some context, Nathan is right that we are working on improving how to make gateways at DO, right now our private network has some limitations for that and we are working to make it more flexible early next year. Unfortunately we won't have a fully managed NAT gateway right then, but we want to do so in the future, just a matter of time.

rafaelrosafu avatar Nov 20 '19 15:11 rafaelrosafu

@rafaelrosafu Do you have any update of this?

vuphuong87 avatar Mar 13 '20 02:03 vuphuong87

VPC was just released, but we still need a NAT Gateway product.

klausenbusk avatar Apr 29 '20 07:04 klausenbusk

I need it !!

lfelguetac avatar Sep 05 '20 05:09 lfelguetac

@rafaelrosafu a year has nearly passed. Do you have any update on this?

klausenbusk avatar Nov 05 '20 19:11 klausenbusk

Hi @rafaelrosafu any update you can share?

chandanpasunoori avatar Apr 13 '21 19:04 chandanpasunoori

This is really important nowadays. Most people do not want to manage their NAT Gateways or make sure its not a singe point of failure. Any news on that?

vkruoso avatar Aug 25 '21 12:08 vkruoso

Any update on this? thanks

adarmanto avatar Jan 18 '22 14:01 adarmanto

Any update? As soon as DO would have NAT gateway, i am migrating from AWS :)

iNviNho avatar Feb 11 '22 00:02 iNviNho

Not yet unfortunately, but we do realize it's a frequently requested feature. Will certainly be considered for roadmap planning.

timoreimann avatar Feb 11 '22 00:02 timoreimann

Much needed feature

mihma avatar Apr 13 '22 20:04 mihma

For now will be great at least to enable such NAT in Cillium

simonoff avatar Apr 21 '22 19:04 simonoff

for now it's has this: https://github.com/digitalocean/k8s-staticroute-operator/ but any ideas how it make resiliancy or fault tolerance it's not have..

you can create a droplet and make it as your egress gateway, but if this droplet down.. your egress traffic stop working..

moovs avatar Feb 15 '23 12:02 moovs

We would like to see this feature as well

websmurf avatar Mar 01 '23 09:03 websmurf

Hi, We need this too and want to know where are we with this?

anuragpathak21 avatar Mar 02 '23 00:03 anuragpathak21

Yes please, no updates from Nov 2019 almost 4 years :)

SergkeiM avatar Mar 02 '23 14:03 SergkeiM

This feature is currently blocking me from using DOKS

gofastlily avatar Apr 18 '23 22:04 gofastlily

a NAT gateway is really neccesary for VPC networking, it's blocking me from using DOKS

duclm2609 avatar May 07 '23 14:05 duclm2609

I don't think NAT Gateway is planned in near future, best way to go about it is using crossplane. I deployed it for two of my clusters and so far it's working just fine. If you want to give it a try then you can follow the URL : https://github.com/digitalocean/k8s-staticroute-operator/

anuragpathak21 avatar May 07 '23 23:05 anuragpathak21

I think this is really needed feature, I am thinking to move all my cluster from DO to AWS as this is in discussion since 4 years and yet no action on this from DO side.

sagaraspl avatar Aug 23 '23 09:08 sagaraspl

It's unfortunate that this hasn't been added yet; I've been waiting for it since Kubernetes came out on DO.

While it would certainly be possible to manually create a gateway droplet and route egress traffic through it, it adds an additional point of failure for customers.

For SaaS companies to serve certain types of customers (think governments & large companies), providing said customers with a list of IPs that they must add to their allowlist is a hard requirement for them, and I have no doubt that the fact that this feature not being available is deterring smaller companies from using DigitalOcean specifically for that reason.

It would be very nice to have an estimate of when (or whether) this feature will be worked on. Though I am sure there are more pressing matters at hand for DO, it would at least allow people to plan accordingly.

TwiN avatar Sep 26 '23 22:09 TwiN

@rafaelrosafu Any updates on this or at least a roadmap? We have third party services that requires us to add ip addresses to their whitelist so we can use their API. We can't use droplet as a gateaway as this is will be both a bottleneck and a point of failure. Currently we manually added nodes public ip addresses to the whitelist, but we are considering moving to another cloud provider that has this functionallity.

M144-Coder avatar Oct 02 '23 06:10 M144-Coder

👋 Timo here from DO.

Thanks for all the feedback. We're aware that NAT egress gateway continues to be a frequent customer request. It is definitely on our roadmap, though we cannot speak to specific timelines. We do want to make sure that we nail the right customer experiences.

In the meantime, https://github.com/digitalocean/k8s-staticroute-operator may be an acceptable workaround. (Yes, we're aware it has a few gaps and doesn't serve all customers well.)

timoreimann avatar Oct 02 '23 11:10 timoreimann

5 years its in your roadmap

simonoff avatar Apr 10 '24 13:04 simonoff

I am not sure if it is still on your roadmap or if they are keeping us waiting. It has been almost 5 years and there still seems to be no progress.

mertcangokgoz avatar May 20 '24 22:05 mertcangokgoz

@timoreimann Any news? 👀

TwiN avatar Jul 03 '24 03:07 TwiN