Balazs Kegl
Balazs Kegl
It happens sometimes that we call the same feature extraction on all submissions and that it takes a lot of time. We could use the idea here to cache the...
When RAMP is used for developing models for a problem, we may want to tag certain versions of a submission, and even `problem.py`, together with the scores. One idea is...
`ramp-test` should have an optional `--verbose` that is passed to `workflow.train_submission` and `workflow.test_submission` which can pass it to fit and predict.
On some workflows it is possible that the output dimension changes from one dataset to another. At this time we need to have the output dimension hard-coded when the regression...
hyperopt
We'll be starting to add a hyperopt/automl feature to ramp-workflow. The goal is to make it easy to convert a submission into a template with hyperparameter placeholders, and to add...
At this time `y_pred` objects are wrapped into `Predictions` types, read out from there, and passed to scoring. Two issues: 1) they are not converted to and deconverted from zipped...
There are weird errors in the full test: https://travis-ci.org/paris-saclay-cds/rampwf-kits-test-master
On my mac pytest (the MNIST kit) is failing with the error in the subject. I did `pip install -U tensorflow`. Should we modify the kit? https://github.com/keras-team/keras/issues/9621
If we want to be able to deploy trained models semi-automatically (e.g., but hand-selecting the model or models), we will need to solve the pickling issue. The first problem is...