hyper-engine icon indicating copy to clipboard operation
hyper-engine copied to clipboard

In which method do the system choose hyper-parameters?

Open dyj0215 opened this issue 6 years ago • 1 comments

I am just a little confused.

When i changed the neural network setting with concrete parameters, because i just only want to optimize learning rate, the second training will use a new learning rate to train the neural network.

For example, after the first training, i got a final accuracy=0.8172. And then, it will go for a second training with a new learning rate. But the final accuracy maybe be very bad. I thought, after one training, the second training will use the old results to train this model, and then get a better result. But actually, it may get a worse result.

So i want know, how do this system choose the next learning rate? Thank you so much.

dyj0215 avatar Dec 16 '19 15:12 dyj0215

Your issue is unclear. Please provide the original spec that you used, the output and then changes that you've made.

maxim5 avatar Dec 16 '19 20:12 maxim5