Anonygento icon indicating copy to clipboard operation
Anonygento copied to clipboard

Running anonymiser on database with 100k+ customers

Open istvano opened this issue 11 years ago • 1 comments

Thanks again for this great plugin. I think it is very essential for every project to be able to anonymise data.

I am wondering if you what we could do to change the process which loads the whole collection of entities as we have customer table over 100k+ customers thus running the code requires like 2gb+ memory and still out of memory error occurs.

could you run the query using paging to make sure the system does not run out of memory ?

something like this could be useful ->

http://www.atwix.com/magento/working-with-large-collections/

http://www.fontis.com.au/blog/magento/loading-large-collections

Thanks

istvano avatar Nov 25 '13 00:11 istvano

Thanks for that bug report! Nice enhancement! I will take a look next time.

SchumacherFM avatar Nov 25 '13 01:11 SchumacherFM