ATM icon indicating copy to clipboard operation
ATM copied to clipboard

Published 20 hours ago • verified publisher icon HDI-Project

Allow custom evaluation metrics

Open bcyphers opened this issue 6 years ago • 2 comments

Right now, it's only possible to configure a datarun to use methods and metrics that are included with the library. It should be possible to pass JSON files for custom machine-learning methods and Python files/functions for custom metrics. This can be implemented in much the same way that custom tuners/selectors for BTB are handled.

bcyphers avatar Jan 14 '18 20:01 bcyphers

Custom methods are in, as of #60. Still need to do custom metrics.

bcyphers avatar Jan 17 '18 17:01 bcyphers

This issue should only pertain to custom metrics. Custom methods are covered in #113.

micahjsmith avatar Feb 19 '19 21:02 micahjsmith