uncertainpy icon indicating copy to clipboard operation
uncertainpy copied to clipboard

Calculation stalls at 'Calculating Statistics from PCE'

Open mckinnonm opened this issue 3 years ago • 2 comments

Hello,

I am trying to conduct PCE for uncertainty quantification for a model that produces time series data. The output is 1200 data points. I am doing UQ with 11 uncertain input parameters, and so PCE requires 2732 function calls. I have taken advantage of multiprocessing and I am currently running this job utilizing all the cores of a 48 core machine. This makes the sampling relatively fast (about 5.5 hours for all the function calls) and 'Calculating PC for each feature' requires about 3 minutes.

When it comes to 'Calculating statistics from PCE' the computation appears to stall. I have not dug into the code to see how many and what operations are required during this step, so maybe this just requires a lot of time to compute, but my machine has been sitting idle for over 12 hours with this message. Is this a reasonable amount of time for this calculation?

If this is actually indicative of an error, I would recommend including a timeout and error message into the code.

Thanks.

mckinnonm avatar Oct 21 '21 09:10 mckinnonm

Hello,

I also had a similar experience. The "Calculating statistics from PCE" step takes aprox. 30s for 4 parameters, 3 minutes for 5 and around 1h for 6. I have not tried with more parameters. This step is not parallelized and I used a 3Ghz CPU. I wonder if this part of the code cannot be made more efficient as It seems to need a lot of time for > 6 parameters.

gdmiron avatar Nov 22 '21 07:11 gdmiron

I experienced the same problem.

tfriedel avatar Aug 24 '22 14:08 tfriedel