ATM
ATM copied to clipboard
Allow custom evaluation metrics
Right now, it's only possible to configure a datarun to use methods and metrics that are included with the library. It should be possible to pass JSON files for custom machine-learning methods and Python files/functions for custom metrics. This can be implemented in much the same way that custom tuners/selectors for BTB are handled.
Custom methods are in, as of #60. Still need to do custom metrics.
This issue should only pertain to custom metrics. Custom methods are covered in #113.