Cornell-MOE icon indicating copy to clipboard operation
Cornell-MOE copied to clipboard

[Question] About the derivitive mode. How I pass the derivative to the optimizer if I write the objective function with a autodifferentiation code?

Open floatingCatty opened this issue 2 years ago • 1 comments

Hello! Thanks for providing such a powerful library.

I am currently implementing some optimization algorithm that combine the gradient descent and BO. And the code is written with pytorch, so, in each evaluation, I can get the gradient of the loss w.r.t. the parameters. How can I pass the gradient to the BO optimizer with derivatives to accelerate its convergence ?

Thanks a lot for your time.

floatingCatty avatar Jan 10 '23 13:01 floatingCatty

I have the same problem

MaAl13 avatar Mar 19 '24 14:03 MaAl13