KerasQuantileModel icon indicating copy to clipboard operation
KerasQuantileModel copied to clipboard

Cannot replicate fit

Open cosmin-novac opened this issue 4 years ago • 2 comments

Hi. I'm trying to replicate your notebook results, but running the code on my machine with no changes leads to these unflattering results:

image

Any ideas?

Edit: For the sake of completeness:

image

cosmin-novac avatar Jul 31 '20 15:07 cosmin-novac

Okay, I managed to fix this by using adam instead of adadelta as optimizer. The point prediction is good now, but then the quantiles fall out of place: image

cosmin-novac avatar Jul 31 '20 16:07 cosmin-novac

I managed to get somewhat accetable quantiles using RMSprop as optimizer. But it's scary how results can differ...

image

cosmin-novac avatar Jul 31 '20 16:07 cosmin-novac