Valerii Pokrovskii

Refactoring preprocessing

4

Solving issue https://github.com/nccr-itmo/FEDOT/issues/812 The main changes: 1) Ohe-hot-encoding and simple_imputation are deleted from default model pool 2) Cleaning preprocessor become after fold evaluation 3) Due to (3) we need to...

Fix integration tests

2

Integration tests are fixed https://github.com/nccr-itmo/FEDOT/issues/752

Bug <X has N features but model is expecting M features>

1


Tuner refactoring

7

Now tuner uses metrics that not compatible with composer metrics. Also it has a monolith structure. What should be done: - [x] Union metrics for composer and tuner - [x]...

Boosting mutations doesn't work due to `available_operations` for classification doesn't contains regression models. Try to debug [this ](https://github.com/nccr-itmo/FEDOT/blob/master/fedot/core/composer/gp_composer/specific_operators.py#L67 )line during running FEDOT Also i think that we should remove this...

We should to make a research to find a reason for such behavior. Examples  

Such integration tests are outdated and should be repaired. - [test_exogenous_ts_example](https://github.com/nccr-itmo/FEDOT/blob/master/test/integration/real_applications/test_examples.py#L48) - [test_nemo_multiple_points_example](https://github.com/nccr-itmo/FEDOT/blob/master/test/integration/real_applications/test_examples.py#L56) - [test_api_example](https://github.com/nccr-itmo/FEDOT/blob/master/test/integration/real_applications/test_examples.py#L93) - [test_spam_detection_problem](https://github.com/nccr-itmo/FEDOT/blob/master/test/integration/real_applications/test_real_cases.py#L91) - [test_multi_modal_case](https://github.com/nccr-itmo/FEDOT/blob/master/test/integration/real_applications/test_real_cases.py#L100) - [test_classification_quality_improvement](https://github.com/nccr-itmo/FEDOT/blob/master/test/integration/quality/test_quality_improvement.py) - [test_synthetic_regression_automl](https://github.com/nccr-itmo/FEDOT/blob/master/test/integration/quality/test_synthetic_tasks.py#L66) - [test_timeout](https://github.com/nccr-itmo/FEDOT/blob/master/test/integration/api_params/test_main_api_params.py#L43) - [test_profiler](https://github.com/nccr-itmo/FEDOT/blob/master/test/integration/test_profiler.py)

Some examples are not covered by integration tests

1

Examples - [project_import_export.py](https://github.com/nccr-itmo/FEDOT/blob/master/examples/project_import_export.py) (also should be refactored as function) simple - [run_import_export_example](https://github.com/nccr-itmo/FEDOT/blob/master/examples/simple/pipeline_import_export.py) - [run_pipeline_and_history_visualization](https://github.com/nccr-itmo/FEDOT/blob/master/examples/simple/pipeline_and_history_visualization.py) - [launch_multitask_api_example](https://github.com/nccr-itmo/FEDOT/blob/master/examples/simple/multitask_classification_regression_api.py) simple/ts_forecasting - [clstm](https://github.com/nccr-itmo/FEDOT/blob/master/examples/simple/time_series_forecasting/clstm.py) - [show_fitted_time_series](https://github.com/nccr-itmo/FEDOT/blob/master/examples/simple/time_series_forecasting/fitted_values.py) - [tuning_pipelines ](https://github.com/nccr-itmo/FEDOT/blob/master/examples/simple/time_series_forecasting/tuning_pipelines.py) simple/regression - [run_regression_example](https://github.com/nccr-itmo/FEDOT/blob/master/examples/simple/regression/api_regression.py) - [regression_with_tuning](https://github.com/nccr-itmo/FEDOT/blob/master/examples/simple/regression/regression_with_tuning.py) simple/interpretable...

Make experiment for calculating overhead in using multiprocessing

1

Perform experiment: 1) Run fitting n pipelines in multiprocessing mode 2) Run fitting n pipelines in single process mode 3) Calculate overhead for creating a process

Repair add as a child

1

Issues with _add_as_child mutation were solved. Also added tests for checking correctness of default mutations