tsml-eval
tsml-eval copied to clipboard
Evaluation tools for time series machine learning algorithms.
Automated weekly update to `.pre-commit-config.yaml` hook versions.
### Describe the feature or idea you want to propose My basic use case is 1. Run all 112 on cluster for algo X 2. Compare X performance to reference...
### Describe the feature or idea you want to propose Line two in the results files contains a dictionary for classifier parameters e.g. {'batch_size': 100, 'contract_max_n_shapelet_samples': inf, 'estimator': None, 'max_shapelet_length':...
all implemented classifiers (as returned (just names) by list_classifiers) should be at least recognised by set_classifier, even if not dealt with. def list_classifiers(multivariate=False,dictionary=True): cls = [] filter_tags = {} if...
we have 40 datasets now, so it would be good to get reference results with all capable classifiers. I will just track problems here and gather results on the beast....
we are extending to 112 to around 150, including 20+ new problems and equal length versions of the current unequal length data. To do: 1. Finalise list and check all...
triggered by this https://github.com/sktime/sktime/issues/3788 its worthwhile discussing how we thread prior to proposing improvements. HC2 seems to do each component sequentially with all the jobs (n_jobs converted in _threads_to_use in...
DuckDuckGeese, EigenWorms, FaceDetection, InsectWingbeatEq, Siemens (8 missing), Tiselac 7 day timeout EigenWorms, FaceDetection out of memory: DuckDuckGeese, InsectWingbeatEq, Tiselac Siemens crash 
pendigits is very short (length 8) and gives this error when running Arsenal with HIVECOTEv2 
when MUSE is run on univariate, it raises this error.  seems it has overridden the default predict proba to throw an error