Philip May
Philip May
@maxpumperla @easyas314159 started a dedicated issue here: #585
#583 is merged, new issue for callbacks is started and this should be fixed. Can it be closed?
> Essentially, in order to include Hyperband and BOHB into the library, we need to store 4 additional variables with each trial object which are not part of the hyperparameter...
@maxpumperla can you help here please? Thanks Philip
Hi @tangoed2whiskey , Maybe you want to have a look at this here: #267 Here the Trials object gets pickled after an hyperopt run, unpickled and then the Hyperopt is...
What do you think about a timed stopping condition? Instead of telling hyperopt to run for a certain number of evaluations you could tell hyperapt to run x minutes?
What about a time based early stopping? If loss does not improve after x minutes then leave it. Or a mix of time and iterations...
> I think the loss-based stopping is more useful in practice, but why not give users options? We could think about a simple `stopping_criterion` argument to fmin that is None...
> Do you have time to review? @guenthermi @Muennighoff @PhilipMay Hey @malteos . I have almost no knowledge with MTEB. Never implemented anything here. Sorry. Maybe @rasdani could have a...
Thanks for reporting @dragonpaw :-) @HazeeqHaikal if you could provide a PR that would be very nice...