MOE icon indicating copy to clipboard operation
MOE copied to clipboard

Grant user the ability to choose number of mc iterations for calculating ExpectedImprovement and gradient EI seperately

Open jialeiwang opened this issue 10 years ago • 1 comments

Motivation: While stochastic gradient descent algorithm has tolerance to the noise coming from monte carlo estimation of gradient, the noise from estimation of EI has great impact to the performance of the algorithm. To find a better balance between performance vs efficiency, we can set number of mc iterations for estimating gradient low, while number of mc iterations for estimating EI high.

jialeiwang avatar Nov 17 '14 01:11 jialeiwang

If you have some results demonstrating the value/trade-off, I would love to see them :)

suntzu86 avatar Nov 19 '14 22:11 suntzu86