blackjax icon indicating copy to clipboard operation
blackjax copied to clipboard

Implement Multi-Armed Bandit adaptation for SGMCMC algorithms

Open rlouf opened this issue 3 years ago • 0 comments

Blackjax has two stochastic gradient algorithms implementations, but to use them one needs to specify hyperparameters manually, namely the batch size, step size and schedule for SGLD, plus the number of integration steps for SGHMC. @jeremiecoullon has proposed an adaptation scheme MAMBA which on top of relieving users from having to choose hyperparameter values, seems to lead to good values.

Paper: https://arxiv.org/abs/2105.13059 Code: Github

rlouf avatar Jul 06 '22 15:07 rlouf