kernel-tools icon indicating copy to clipboard operation
kernel-tools copied to clipboard

Better handle memory fragmentation.

Open clandmeter opened this issue 9 years ago • 11 comments

@moul and @fabled as discussed on #alpine-linux

Please enable CONFIG_COMPACTION and CONFIG_SLUB. This should prevent oom when memory gets fragmented.

clandmeter avatar Nov 09 '15 12:11 clandmeter

ping @aimxhaisse, is it ok for you too ?

moul avatar Nov 09 '15 13:11 moul

Yes, LGTM.

I don't know why we haven't SLUB enabled, it seems to be the recommended default setting (maybe it's a residue from the 3.2 legacy config). I'd advocate to use these settings on all flavors since it's not a 'local' feature, but a global change we might want everywhere.

aimxhaisse avatar Nov 09 '15 14:11 aimxhaisse

Ok then, @QuentinPerez, can you enable CONFIG_SLUB ?

@aimxhaisse do you confirm that in our case, CONFIG_COMPACTION would be useless so we can skip it ?

moul avatar Nov 09 '15 16:11 moul

I believe in this case CONFIG_COMPACTION is the more important option. It allows kernel to defragment physical memory to contiguous blocks when it's fragmented.

fabled avatar Nov 09 '15 17:11 fabled

Yes, sorry I mis-interpreted the reference to 'huge pages' in the description of the option, I was under the impression it was specific to x86 huge-pages, but that's not the case.

LGTM for both configs.

aimxhaisse avatar Nov 10 '15 09:11 aimxhaisse

Both configs were updated, @QuentinPerez can you see with @aimxhaisse to start long-test runs against some of those kernels ?

moul avatar Nov 10 '15 10:11 moul

@moul when will new kernels with these options be available?

clandmeter avatar Nov 11 '15 12:11 clandmeter

@clandmeter we will add a "beta" kernel today so you will be able to give a try In the meantime, we are running our long stability&performance tests

If our tests are successful we will replace all the existing kernels with the new ones

moul avatar Nov 12 '15 10:11 moul

We just released 2 kernels flagged as BETA:

  • 3.2.34-std °32: Marvell LSP kernel + memory compaction and slub enabled
  • 4.2.5-std °265: Mainline kernel + memory compaction and slub enabled

moul avatar Nov 12 '15 15:11 moul

Thank a lot. I will give them a try and report if i find any issues.

clandmeter avatar Nov 12 '15 15:11 clandmeter

Thanks :)

moul avatar Nov 12 '15 16:11 moul