HPOBench icon indicating copy to clipboard operation
HPOBench copied to clipboard

Adding public URLs for tabular benchmark

Open Neeratyoy opened this issue 3 years ago • 3 comments

Added the figshare public URLs. Couldn't successfully test it though.

Tried the following:

from hpobench.benchmarks.ml_mmfb import TabularBenchmark
benchmark = TabularBenchmark(data_dir=None, model="svm", task_id=10101)

Failed with the error TypeError: int() argument must be a string, a bytes-like object or a number, not 'NoneType' at L98 of hpobench/util/data_manager.py

Neeratyoy avatar Aug 19 '21 19:08 Neeratyoy

Codecov Report

Merging #121 (6394521) into development (1a789b7) will increase coverage by 0.02%. The diff coverage is 100.00%.

Impacted file tree graph

@@               Coverage Diff               @@
##           development     #121      +/-   ##
===============================================
+ Coverage        44.34%   44.37%   +0.02%     
===============================================
  Files               41       41              
  Lines             2336     2337       +1     
===============================================
+ Hits              1036     1037       +1     
  Misses            1300     1300              
Impacted Files Coverage Δ
hpobench/util/data_manager.py 57.50% <100.00%> (+0.09%) :arrow_up:

codecov[bot] avatar Aug 31 '21 19:08 codecov[bot]

@PhMueller this branch is now pointing to dev with the other big PR being merged we could merge this directly to dev? and for future updates to the URLs I could just have another PR doing so?

Neeratyoy avatar Sep 01 '21 14:09 Neeratyoy

@KEggensperger updated with changes for CRC rerunning, involving the cost and optimization budgets.

Neeratyoy avatar Nov 05 '21 19:11 Neeratyoy