goptuna icon indicating copy to clipboard operation
goptuna copied to clipboard

Gaussian process surrogate models for the CMA-ES

Open c-bata opened this issue 4 years ago • 2 comments

http://artax.karlin.mff.cuni.cz/~bajel3am/gpcomparison2017/

c-bata avatar Mar 12 '20 06:03 c-bata

Uncertainty criterion

The following paper describes the details of uncertainty criterion.

http://artax.karlin.mff.cuni.cz/~bajel3am/img/pitra2016doubly_preprint.pdf

There are 4 types of uncertainty criteria.

ScreenShot 2020-03-14 17 05 59

The most simple approach which just uses the variance of the first model performs the best.

This and all the following experiments use the criterion Cs^2 which performed best in the first set of experiments ScreenShot 2020-03-14 17 07 25

c-bata avatar Mar 14 '20 08:03 c-bata

In this paper, they use IPOP-CMA-ES. I implemented it at #131.

c-bata avatar Jul 24 '20 11:07 c-bata