bottlerocket icon indicating copy to clipboard operation
bottlerocket copied to clipboard

Upstream cri patch for default RLIMIT_NOFILE

Open zmrow opened this issue 4 years ago • 5 comments

Bottlerocket carries a patch to cri that sets a default RLIMIT_NOFILE, introduced to help remediate this OOM issue.

This configurable limit seems more generally useful, so we should upstream the patch.

zmrow avatar Dec 14 '20 17:12 zmrow

@zmrow we are also facing issues with rlimit on our elasticsearch clusters, and the current openfiles are shown as (-n) 65536. Is there a way to use the increased limit, the clusters are bootstrapped using eksct.

rverma-dev avatar Sep 10 '21 01:09 rverma-dev

Thanks for letting us know - we'll take this into consideration when planning and considering if or how we can make this more configurable.

zmrow avatar Sep 10 '21 17:09 zmrow

Upstream issue: https://github.com/containerd/containerd/issues/6063

zmrow avatar Sep 28 '21 21:09 zmrow

PR: https://github.com/containerd/containerd/pull/6064

zmrow avatar Sep 28 '21 21:09 zmrow

hi @zmrow, I tested with 1.7.2-28782dce, there's one last setting that required to pass elasticsearch boostrap check which is the memlock. Is it possible to have memlock hard limit set to unlimited?

Thanks.

tanvp112 avatar May 29 '22 08:05 tanvp112

@zmrow do you know what happened with this?

stmcginnis avatar Feb 16 '23 21:02 stmcginnis

We deleted the patch in #2697 because we now set it via the OCI-defaults

webern avatar Feb 16 '23 21:02 webern

I'm wondering about @tanvp112's memlock mention. Maybe that should be its own issue so we can track it there and not muddy things.

Any idea if that is still needed @tanvp112?

stmcginnis avatar Feb 16 '23 21:02 stmcginnis

Seems like it's still needed and we should expand the oci-defaults.resource-limits settings for all the limits in any case.

bcressey avatar Feb 17 '23 03:02 bcressey

@stmcginnis, yes, this setting is very much needed for in-memory (eg. redis, elk... just to name a few) workloads.

tanvp112 avatar Feb 17 '23 07:02 tanvp112

I am going to close this since the topic of this issue has been addressed and open a new issue to track expanding the oci-defaults.resource-limits knobs.

Tracking in #2814

stmcginnis avatar Feb 17 '23 13:02 stmcginnis