ietoolkit icon indicating copy to clipboard operation
ietoolkit copied to clipboard

[iedorep]: Memory management issues

Open bbdaniels opened this issue 2 years ago • 2 comments

Crashes when user manually sets memory in dofile -- assuming this is because Stata uses clear all or equivalent in background when memory settings are changed. Need to check.

@kbjarkefur -- Having a different issue where it seems that making so many temp copies of a 40MB dataset is causing Stata to be unable to restore or store locals appropriately. Have you seen anything like this before? It is 30 vars, 250k obs so it's not enormous, and even 100 copies of it would only make 4GB which should not be a strain on my system at all. And yet I have locals disappearing and getting the message unable to restore data due to insufficient memory in cases.

bbdaniels avatar Jun 07 '22 19:06 bbdaniels

One option here is to not save every data state to use cf later, and instead use the hashes or signatures. This would lead to some loss of precision.... but perhaps it is worth it, at least optionally, if this is hard to solve.

bbdaniels avatar Jun 07 '22 19:06 bbdaniels

Solution proposed in 975f66c2304b142fd6541cd04a050b51d2e9d987

bbdaniels avatar Aug 31 '22 19:08 bbdaniels