Results 3 comments of maor096

The same problem we encountered,We are using AB experiments for hyperparameter tuning, where there are 3 experimental groups, 3 optimization goals, and 1 constraint. Specific information can be found in...

> Hi all, I would definitely recommend “reshuffling” (or simply creating a new experiment) for each batch. Otherwise you have carryover effects. Variance reduction is always a good idea. We...

@eytan hi eytan I have sent an email to you based on the information at http://eytan.GitHub.io, looking forward to your reply. Thank you very much.