flare icon indicating copy to clipboard operation
flare copied to clipboard

How to optimize the hyperparameters?

Open kitpeng11 opened this issue 5 years ago • 2 comments

The printed out likelihood is negative after 50 optimization. Is there any way to get a set of good hyperparameters? Thanks

kitpeng11 avatar Sep 06 '20 08:09 kitpeng11

You can try restarting from a different initial guess of hyperparameters. But the most likely reasons are that you don’t have enough training data, or the system can’t be adequately modelled by the kernel you chose.

mkrompiec avatar Sep 21 '20 19:09 mkrompiec

Hi kitpeng11,

You can interpret the log marginal likelihood as a measure of how well your training data is described by the current model. As mkrompiec notes, a negative likelihood after hyperparameter optimization usually indicates that a more sophisticated model is needed.

Have you tried repeating the optimization with different kernels?

Best, Jon

jonpvandermause avatar Oct 01 '20 13:10 jonpvandermause

Close stale issue

YuuuXie avatar Dec 04 '22 16:12 YuuuXie