ldapdomaindump icon indicating copy to clipboard operation
ldapdomaindump copied to clipboard

Intermediate flush to disk

Open edermi opened this issue 6 years ago • 1 comments

First of all thanks for the nice project. Would it be possible to implement some regular "disk flushes"? I tried to dump a slightly large AD today and - even with the -m option enabled - easily exhausted the 12GB RAM in my VM. Writing information to disk and clearing internal data structures from time to time will probably drastically reduce the memory consumption.

edermi avatar Sep 07 '18 19:09 edermi

This is kind of a known issue that is still on my to-do but requires a lot of changes. Reason for this is that all the (recursive) group memberships are calculated in-memory so all data has to be loaded first before the structured files can be written to disk. I do have some ideas to make this more efficient but this requires restructuring a major part of the code, which I don't have the time for currently.

dirkjanm avatar Sep 08 '18 17:09 dirkjanm