benchmark icon indicating copy to clipboard operation
benchmark copied to clipboard

Add model with inner optimization loop to model repo

Open Chillee opened this issue 5 years ago • 0 comments

An inner optimization loop is when the functional autograd API is used in the forward pass and then the user differentiates through it. Uses include MAML, Energy Based Models, and (shameless self plug) set generation.

Would be nice as it requires autograd in the forward pass, and requires higher order gradients in the backwards pass. Definitely more "researchy" code.

Chillee avatar Nov 20 '20 07:11 Chillee