tsml-eval icon indicating copy to clipboard operation
tsml-eval copied to clipboard

Evaluation tools for time series machine learning algorithms.

Results 76 tsml-eval issues
Sort by recently updated
recently updated
newest added

Automated weekly update to `.pre-commit-config.yaml` hook versions.

maintenance
full pre-commit
no changelog

### Describe the feature or idea you want to propose My basic use case is 1. Run all 112 on cluster for algo X 2. Compare X performance to reference...

enhancement
evaluation

### Describe the feature or idea you want to propose Line two in the results files contains a dictionary for classifier parameters e.g. {'batch_size': 100, 'contract_max_n_shapelet_samples': inf, 'estimator': None, 'max_shapelet_length':...

enhancement
evaluation

all implemented classifiers (as returned (just names) by list_classifiers) should be at least recognised by set_classifier, even if not dealt with. def list_classifiers(multivariate=False,dictionary=True): cls = [] filter_tags = {} if...

enhancement
testing
experiments

we have 40 datasets now, so it would be good to get reference results with all capable classifiers. I will just track problems here and gather results on the beast....

results

we are extending to 112 to around 150, including 20+ new problems and equal length versions of the current unequal length data. To do: 1. Finalise list and check all...

results

triggered by this https://github.com/sktime/sktime/issues/3788 its worthwhile discussing how we thread prior to proposing improvements. HC2 seems to do each component sequentially with all the jobs (n_jobs converted in _threads_to_use in...

DuckDuckGeese, EigenWorms, FaceDetection, InsectWingbeatEq, Siemens (8 missing), Tiselac 7 day timeout EigenWorms, FaceDetection out of memory: DuckDuckGeese, InsectWingbeatEq, Tiselac Siemens crash ![image](https://user-images.githubusercontent.com/9594042/193565951-fb796419-9274-425a-96c3-8eafbab411e1.png)

pendigits is very short (length 8) and gives this error when running Arsenal with HIVECOTEv2 ![image](https://user-images.githubusercontent.com/9594042/201906740-778a25c2-27e7-496d-9432-e377840b56f6.png)

when MUSE is run on univariate, it raises this error. ![image](https://user-images.githubusercontent.com/9594042/197740289-d5b00a73-0754-4384-bf6a-354687946853.png) seems it has overridden the default predict proba to throw an error