CAVE icon indicating copy to clipboard operation
CAVE copied to clipboard
verified publisher icon automl

Quantify Heterogeneity

Open mlindauer opened this issue 8 years ago • 0 comments

To provide some pointers whether a PIAC approach could be better than plain AC, you could provide some heterogeneity measures.

  1. See: http://ml.informatik.uni-freiburg.de/papers/12-LION-hoosch12a.pdf
  2. Compute oracle performance - incumbent performance. The oracle performance is approximated by the best observed performance on each instance (without using an EPM).

mlindauer avatar Dec 01 '17 12:12 mlindauer