wee_alloc icon indicating copy to clipboard operation
wee_alloc copied to clipboard

wee_alloc leaks memory

Open CryZe opened this issue 5 years ago • 5 comments

Describe the Bug

wee_alloc is supposedly useful for embedded devices, but I tried it over the weekend and of the total amount of memory of 256 KiB, wee_alloc is only able to allocate 2.2 KiB in its default configuration. Something seems to be off here.

Steps to Reproduce

  1. Use the static array backend.
  2. Configure 256 KiB of memory.
  3. Do a few allocations in the range 1 - 700 bytes like in the image provided.
  4. wee_alloc should run out of memory very early.

Expected Behavior

It should be able to use at least 200 KiB or so.

Actual Behavior

It can only allocate 2.2 KiB.

https://i.imgur.com/XILjeLr.png

CryZe avatar Sep 02 '19 12:09 CryZe

I am also experiencing this issue, which is that an OOM error arises in my system when trying to push elements to an alloc::vec::Vec of u32's, right around the 65th element (which is just over 256k bytes of memory). I only have the static_array_backend feature enabled, and the error persists even after adjusting the WEE_ALLOC_STATIC_ARRAY_BACKEND_BYTES env var to twice the default during compilation. For more context wee_alloc is being used as a global allocator in a no_std bare metal OS that is being built. So it is possible there are some confounding variables at play here, but I am fairly certain this is due to wee_alloc.

Are there any fixes or workarounds people have found?

nand-nor avatar Sep 26 '19 15:09 nand-nor

I switched to dlmalloc, which worked perfectly fine.

CryZe avatar Sep 26 '19 15:09 CryZe

@CryZe, @nand-nor: are y'all using the size classes feature? I'd recommend against using it in super constrained memory situations (eg only 256k of heap space) since it will prefill each size class's free list with 8k from the main free list. It is essentially trading more fragmentation for faster allocation of small objects.

I think using the size classes in a constrained memory environment, combined with the alignment bug that #87 is fixing, could explain this behavior.

If you were using the size classes feature, I'd be interested in if you could re-test with size classes disabled and the fix in #87 and report if you're seeing the same behavior or not.

fitzgen avatar Oct 28 '19 20:10 fitzgen

@fitzgen I have not been using the size classes feature (my target platform has plenty of memory) so the tests I ran separately from tests.sh after enforcing scratch heap alignment did not have this feature enabled.

nand-nor avatar Oct 29 '19 15:10 nand-nor

I also tried both variants (back then) and both were failing to allocate way too early, though with size classes (as seen in the OP), it was even earlier than without.

CryZe avatar Oct 29 '19 16:10 CryZe