ludwig icon indicating copy to clipboard operation
ludwig copied to clipboard

additional benchmark configs

Open jppgks opened this issue 2 years ago • 2 comments

Adds configs to the benchmark directory for datasets:

  • amazon employee access challenge
  • mushroom edibility
  • naval
  • numerai 28.6
  • sarcos

jppgks avatar Aug 24 '22 09:08 jppgks

Unit Test Results

         6 files  ±       0           6 suites  ±0   3h 41m 36s :stopwatch: + 26m 43s   3 535 tests +   559    3 460 :heavy_check_mark: +   563    75 :zzz:  -   4  0 :x: ±0  10 605 runs  +1 677  10 362 :heavy_check_mark: +1 707  243 :zzz:  - 30  0 :x: ±0 

Results for commit 6fec29ce. ± Comparison against base commit 25f04e85.

:recycle: This comment has been updated with latest results.

github-actions[bot] avatar Aug 24 '22 10:08 github-actions[bot]

Stratified split is due to the highly imbalanced dataset.

Good call on the simplification, will add!

jppgks avatar Aug 24 '22 21:08 jppgks