kurobako

kurobako copied to clipboard

Add batch-evaluate mode

2

Kurobako has `evaluate` subcommand that evaluates a problem at a given set of params. However, when we want to repeatedly evaluate different sets of params and the problem needs to...

contramundum53

Add batch sampling support

2

sile

Consider to use TCP socket for inter process communication

6

Currently, the standard input and output are used to communicate with external program problems and solvers but it turned out that it's not a good design. Because many Python libraries...

sile

Currently, debugging subprocesses run by kurobako is rather painful. There can be multiple possible improvements. * We could show that "During study <study setting>, subprocess <id> finished with an error...

contramundum53

Docker Hub migration to optuna

1

See https://github.com/optuna/kurobako/pull/39#discussion_r657630351 Ref. https://hub.docker.com/r/sile/kurobako, https://hub.docker.com/u/optuna

hvy

It may be useful to support metrics that aren't visible to solvers but can be used in the ranking evaluation or plotting phases.

sile

Add Other Performance Metrics

1

Hi! I would like to use the following performance metrics to validate the hyperparameter optimization algorithms with `kurobako`. - The number of budgets to reach the X% point of the...

HideakiImamura

Add benchmark results of RandomSolver as built-in baselines

1

sile

[Optuna v3.0](https://github.com/optuna/optuna/releases/tag/v3.0.0) has been released, and it deprecated the old distributions and introduced the new distributions. We should replace the old definitions with new ones. ## What we should change....

HideakiImamura

Bump memoffset from 0.6.1 to 0.6.5

1

Bumps [memoffset](https://github.com/Gilnaa/memoffset) from 0.6.1 to 0.6.5. Commits 01e2e42 v0.6.5 fd81a21 Merge pull request #63 from yvt/fix-nightly 4248395 Remove #![feature(const_raw_ptr_deref)] 4c71bed Remove #![feature(const_maybe_uninit_as_ptr)] b14262b Merge pull request #62 from matklad/idioms d41cc25...

dependabot[bot]